USE  OF  OTTAWA  ANKLE  DECISION  RULES  TO  EVALUATE  BLUNT  ANKLE 
TRAUMA  CASE  STUDIES  BY  UNITED  STATES  AIR  FORCE  HEALTH  CARE 
PROVIDERS 


William  Anthony  Novak 


APPROVED 


5  Apr  99 


Carol  Ledbetter,  PhD,  RN-C,  CS,  FNP 

5  Apr  99 

Date 

Eugene  Levine,  PhD 

5  Apr  99 

Date 

Patricia  McMullen,  CRNP,  CNS,  MS,  JD 

Date 

APPROVED 

F.  G.  Abdellah,  Ed.D.,  ScD.,  RN,  FAAN  Date 

Dean 


1 


DISCLAIMER  STATEMENT 


Department  of  Defense 

This  work  was  supported  by  the  Uniformed  Services  University  of  the  Health  Sciences 
protocol  No.  T06182.  The  opinions  or  assertions  contained  herein  are  the  private 
opinions  of  the  author  and  are  not  to  be  construed  as  official  or  reflecting  the  views  of  the 
Department  of  Defense  or  the  Uniformed  Services  University  of  the  Health  Sciences  . 


COPYRIGHT  STATEMENT 


The  author  hereby  eertifies  that  the  use  of  any  eopyrighted  material  in  the  thesis  entitled: 

USE  OF  OTTAWA  ANKLE  DECISION  RULES  TO  EVALUATE  BLUNT  ANKLE 
TRAUMA  CASE  STUDIES  BY  UNITED  STATES  AIR  FORCE 
HEALTH  CARE  PROVIDERS 

Beyond  brief  exeerpts  is  with  the  permission  of  the  eopyright  owner,  and  will  save  and 
hold  harmless  the  Uniformed  Serviees  University  of  the  Health  Seienees  from  any 
damage,  whieh  may  arise  from  sueh  copyright  violations. 


IV 


ABSTRACT 


Practice  guidelines  are  developed  through  a  formal  proeess  incorporating  the  best 
scientific  evidence  of  effeetiveness  with  expert  opinions.  Clinical  guidelines  like  the 
Ottawa  Ankle  Rules  (OAR)  may  serve  an  inereasingly  important  role  within  the  evolving 
role  of  nurse  practitioners  (NPs)  and  physician  assistants  (PAs)  within  the  United  States 
Air  Foree  (USAF)  health  eare  model  called  TRICARE.  The  OAR  have  been  found  to  be 
speeifie  and  valid  deeision  rules  concerning  the  common  problem  of  blunt  ankle  trauma 
(BAT).  Few  x-rays  for  this  eondition  are  positive  for  elinioally  signifieant  fraetures.  Use 
of  the  OAR  by  USAF  NPs  and  PAs  is  unknown.  The  purpose  of  this  deseriptive  study 
was  to  determine  if  a  sample  of  NPs  and  PAs  are  aware  of  the  OAR.  Seeondly,  what 
elinieal  information,  tests  or  rules  are  used  by  respondents  to  eorreetly  determine  whether 
or  not  to  x-ray  is  warranted  in  written  ease  BAT  seenarios.  This  study  asks  if  there  is  a 
theoretical  cost  benefit  in  OAR  use?  Deseriptive  data  were  gathered  using  case  scenarios 
to  measure  diagnostic  accuracy.  Data  from  29  respondents  indicate  lack  of  awareness  of 
the  OAR.  There  was  a  1%  differenee  in  aeeuracy  between  the  18  NPs  and  1 1  PAs  in  1 1 
seenarios.  A  formula  applied  to  the  eases  of  inaeeurately  ordered  x-rays  demonstrated  a 
theoretieal  cost  benefit  of  $1,300  to  $3,900.  Use  of  the  OAR  after  a  brief  edueation 
proeess  may  improve  patient  satisfaetion,  deerease  waiting  times,  and  demonstrate  eost 
savings  with  no  increase  in  rate  of  missed  fraetures,  or  inereased  provider  liability.  Use 
of  the  OAR  may  faeilitate  effieient  evaluation  of  BAT  in  field  eonditions. 

Keywords:  practice  guidelines  Ottawa  ankle  rules  USAF  blunt  trauma  x-rays  cost  benefit 
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PREFACE 


This  research  was  conducted  to  provide  information  on  the  use  of  the  Ottawa  ankle 
decision  rules  (OAR)  by  an  active-duty  sample  of  United  States  Air  Force  nurse 
practitioners  and  physician  assistants  assigned  in  the  continental  United  States.  It  was 
designed  to  assess  respondent  s  ability  to  accurately  assess  whether  or  not  an  x-ray  was 
required  in  multiple,  blunt  ankle  trauma,  written  case  scenarios,  and  encourage  the  use  of 
the  OAR  as  part  of  a  thorough,  cost-effective  assessment  process. 
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Without  you  I  am  less  -  (lOU  BIG-  Rooster) 

-To  dad. 
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It  s  OK  dad,  we  understand 

let  me  know  they  really  did.  Without  their  wind,  I  d  have  never  flown 

-To  Albert,  Lraneis  and  my  patients:  Aspire  to  know.  Go  to  the  faets  and  examine 
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CHAPTER  ONE:  INTRODUCTION 


Background 

The  foot  and  ankle  are  the  most  frequently  injured  and  imaged  parts  of  the  body 
(Prokuski,  &  Saltzman,  1997;  Trevino,  Davis,  &  Heeht,  1994).  This  hasn  t  always  been 
true.  Kevles  (1997)  reports  that  during  the  first  decades  of  the  20th  eentury,  radiologieal 
studies  were  a  novelty,  a  euriosity,  and  status  symbol.  Kevles  asks  us  to  eonsider  the 
story  of  young  John  Boskirk: 

Who  in  May  1912,  was  putting  awnings  on  the  windows  of  the  post  offiee  in 
Omaha,  Nebraska  and  fell  18  feet  to  the  ground,  and  was  treated  for  a  sprained  ankle 
at  a  nearby  hospital.  Seventeen  days  later,  still  unable  to  stand  on  the  hurt  foot,  a 
new  doetor  in  eharge  of  his  ease.  Dr.  Pinto,  suggested  that  he  get  an  x-ray. 

The  pieture  was  eonelusive-  he  had  a  broken  bone-  and  Boskirk  sued.  At  the  trial 
four  doctors  testified  that  the  failure  to  have  an  X-ray  pieture  taken  as  an  aid  to 
diagnosis  at  this  time  did  not  indicate  any  laek  of  regular  care.  Boskirk  lost  his 
ease.  (p.  69) 

Radiology  is  a  helpful  teehnology  that  has  assisted  health  eare  providers  relieve  pain 
and  suffering.  Some  have  wondered  in  the  past  two  and  a  half  deeades,  if  radiologic 
imaging  studies  are  as  important  as  onee  thought  (Sujitkumar,  Hadfield,  &  Yates,  1986). 
In  this  era  of  health  care  reform  and  managed  eare,  authorities  eurrently  question  the 
neeessity  and  eosts  assoeiated  with  some  radiologie  studies  (Miehelson,  Ahn,  &  Magid, 
1995;  Moloney  &  Rogers,  1979;  Vangsness,  Carter,  Hunt,  Kerr,  &  Newton,  1994). 

Helms  (1989)  reports  a  signifieant  pereentage  of  all  emergeney  department  films  are 
obtained  for  ankle  trauma.  Ligamentous  injuries  ean  usually  be  clinieally  differentiated 
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from  significant  fractures.  Small  bony  avulsions  receive  the  same  treatment  as  ligament 
tears,  and  are  often  diffieult  to  differentiate  from  aeeessory  ossieles.  Johnson,  Shell,  and 
Moyer  (1997)  report  85%  of  ankle  injuries  are  soft  tissue,  and  highlight  the  use  of  the 
Ottawa  Ankle  Rules  (OAR).  Developed  by  seientists  of  the  Ottawa  Civie  Hospital 
(Stiell,  Greenberg  et  ah, 1992;  Stiell,  MeDowell  et  ah,  1992),  the  OAR  have  proven  to  be 
a  valid  and  sensitive  set  of  deeision  rules.  The  rules  use  a  standardized  diagram  of  the 
foot  and  ankle,  and  two  simple  sets  of  discriminating  rules,  and  inelude  exelusionary 
eriteria  (Stiell,  MeKnight  et  ah,  1994).  In  most  oases  the  radiologio  test  (ankle  series) 
previously  oonsidered  a  major  determinant  of  the  patient  s  management  oould  be  omitted. 

Stover  (1980)  reports  blunt  ankle  and  foot  trauma  (BAT)  are  among  the  most 
frequently  enoountered  injuries  in  athletio  medioine.  Cookshott,  Jenkin,  and  Pui  (1983) 
oontend  ankle  injuries  may  be  been  responsible  for  up  to  12%  of  the  patients  ooming  into 
an  emergenoy  room,  and  many  are  subjeoted  to  radiographio  examination  of  the  ankle  or 
foot.  Less  than  15%  of  patients  with  this  problem  have  elinieally  signifieant  fraetures 
(Stiell,  MeKnight  et  ah,  1994;  Tandeter  &  Shvarzman,  1997).  Jaekson  and  Kroenke 
(1997)  report  the  majority  of  patients  have  speeifie  expeetations  for  their  health  eare 
visit  and  often  present  with  explieit  requests  (p.  275).  Patients  experieneing  BAT  expeet 
effieient,  effeetive  eare  that  minimizes  loss  of  funetion  (Jaekson  &  Kroenke,  1997). 

Many  patients  report  to  the  hospital  with  pain.  Besides  pain  relief,  patients  may 
arrive  expeeting  radiologie  tests  to  determine  if  their  ankle  or  foot  has  been  fraetured. 
Radiologie  tests  are  often  unneeessary,  eause  treatment  delays,  and  entail  a  burdensome 
expense  (MeBride,  1997).  A  eommon  praetiee  is  to  take  an  ankle  film  if  a  patient  with  a 
sprain  expeets  it,  even  though  the  elinieal  examination  is  usually  adequate  to  suggest  the 
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appropriate  treatment  (Hale,  1996;  Hall,  1976;  Montague  &  MeQuillan,  1985;  Siekles, 
1997).  Abrams  (1979)  eontended  many  providers  rely  on  radiologie,  rather  than  elinieal, 
follow-up  observation.  In  the  presenee  of  puzzling  BAT,  the  patient  (and  provider) 
would  like  to  believe  that  every  possible  step  is  being  taken  to  solve  it. 

A  valid  and  sensitive  elinieal  praetiee  guideline  may  assist  the  provider  in  deeiding 
in  what  instanee  a  radiologie  exam  may  be  required.  Guidelines  for  the  use  of 
radiography  in  aeute  ankle  injures  were  developed  in  Ottawa,  Ontario  and  presented  in 
1992  (Stiell,  Greenberg,  et  ah,  1992;  Tandeter,  &  Shvartzman,  1997).  The  OAR  have 
been  implemented  and  validated  in  large  multieenter  trials  in  Canada  the  United  States, 
and  other  eountries.  These  deeision  rules  are  speeifie  in  determining  fraeture  in  BAT. 

The  OAR  have  proven  to  have  a  high  degree  of  sensitivity  for  elinioally  signifieant 
fraetures,  are  easy  to  use  by  many  providers  with  varying  experienee  levels,  and  yield 
large  reduetions  in  the  use  of  ankle  radiography  (Auleley  et  ah,  1997;  Stiell,  1996;  Stiell 
et  ah,  1993;  Stiell,  Greenberg  et  ah,  1992;  Stiell,  MeDowell  et  al.,  1992;  Stiell,  MeKnight 
et  ah,  1992;  Stiell,  MeKnight,  et  ah,  1994).  Anis,  Stiell,  Stewart,  and  Laupaeis  (1995) 
eonelude  that  widespread  use  of  the  OAR  would  result  in  signifieant  savings  in  the 
United  States  and  Canada  without  eompromising  eare. 

A  goal  of  the  USAF  Medieal  Serviee  is  to  provide  responsive  and  sensitive  health 
eare.  Using  a  ease  seenario  approaeh  to  examine  the  elinieal  deeision-making  of  USAF 
physieian  assistants,  and  nurse  praetitioners  is  an  appropriate  approaeh  to  an  old  problem. 
Henee,  researeh  as  this  proposal  suggests,  supports  the  provision  of  safe,  effieient  eare  in 
the  emerging  managed  eare  praetiee  environment.  It  will  determine  the  extent  of  the  use 
of  the  OAR,  assist  the  provider  in  meeting  the  patient  expeetations,  proteet  the  highest 
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standards  of  care,  and  has  the  potential  to  demonstrate  eost  savings  the  USAF  health 
serviee  system. 

System  ehanges  have  reeognized  the  potential  of  nurse  praetitioners,  predieted  by 
Monninger  and  Fullerton  in  1984.  Nurse  praetitioner  praetiee  extends  traditional 
nursing  skills,  knowledge,  and  responsibilities  in  sueh  a  way  that  this  relatively  new  role 
of  nurses  is  frequently  eited  as  an  important  and  effeetive  resouree  for  health  eare 
(Monninger,  1988,  p.  104).  Federal  emphasis  on  health  eare  eost  eontainment  has  led  to 
greater  responsibilities  and  expanded  roles  for  advaneed  praetiee  nurses  (MeLain,  1988). 
To  be  aeknowledged  as  powerful  resourees  in  health  eare  reform,  advaneed  praetiee 
nurses  must  demonstrate  their  eapability  to  diseern  and  implement  sueh  eost-effeetive 
and  high-quality  eare  that  the  OAR  offer. 

Sinee  1965,  nurse  praetitioners  have  demonstrated  their  eapability  for  sueeess  in 
safe,  effeetive  primary  health  eare  delivery  both  autonomously  and  in  a  eollaborative 
praetiee  environment  (Feldman,  Ventura,  &  Crosby,  1987;  Spitzer  et  ah,  1990).  Abdellah 
(1997)  reports  that  advaneed  praetiee  nurses  do  provide  eompetent  and  effieient  health 
eare  that  has  resulted  in  overall  eost  savings  and  better  eare  (p.  453).  Managed  eare  has 
evolved  to  be  managed  eosts  and  now  managed  eompetition.  Professionals  working  in 
the  network  (TRICARE)  must  be  valuable  to  the  network,  implying  eompeteney, 
effieieney,  and  marketability  (Madden  &  Ponte,  1994,  p.  56). 

With  the  implementation  of  the  Department  of  Defense  TRICARE  managed  eare 
program  a  new  system  of  integrated  health  delivery  has  begun  in  the  United  States  Air 
Foree  (USAF)  health  serviee  system.  Primary  eare  praetiee  ealls  for  well-developed 
skills  in  patient  management.  The  role  of  the  nurse  praetitioner  in  managed  eare 
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networks  is  multiple,  flexible  and  based  on  interventions  and  outcomes  of  clinical 
practice.  TRICARE  demands  a  right-sizing  of  the  workforce;  models  that  can  utilize  non¬ 
physician  providers  to  a  greater  extent  to  provide  beneficiary  care  (McGee  &  Hudak, 
1995).  Mundinger  (1994)  suggests  that  a  collaborative  model  may  be  the  best  model  as  it 
reduces  cost  while  enhancing  quality  and  comprehensiveness.  The  continued  use  of  non¬ 
physician  providers  will  drive  the  current  emphasis  on  assessment  and  accountability  as  it 
relates  to  outcomes.  Outcome  measures  should  continue  to  be  evaluated  because  they  are 
practical,  available,  and/or  politically  important  (Molde  &  Diers,  1985). 

Outcomes  have  been  defined  as  the  five  D  s:  death,  disease,  disability,  discomfort, 
and  dissatisfaction  (Lohr,  1988).  Satisfaction  is  unique  in  that  it  is  an  outcome  and  it  may 
also  affect  other  outcomes  such  as  death,  disease,  or  disability.  Patient  satisfaction  with 
outcome  will  have  a  significant  bearing  on  how  treatment  modalities  are  marketed  to 
beneficiary  populations.  Stone  (1994)  suggests  research  exploring  interactional  processes 
between  nurse  practitioners  and  clients  needs  to  be  linked  to  patient  outcomes  (p. 

17).  With  the  implementation  of  TRICARE  as  a  capitated  health  care  system,  outcome 
measures  will  be  important  in  selecting  the  most  cost-effective  treatment  options  while 
maintaining  beneficiary  satisfaction  (Jackson  &  Kroenke,  1997).  The  OAR  supports  the 
rationale  of  patient  satisfaction  research:  cost  containment.  Providers  have  at  their 
disposal  decision  rules.  The  OAR  promotes  accurate,  timely  diagnosis  in  the  instance  of 
BAT;  maintain  a  high  standard  of  care  and  have  a  direct,  positive  influence  on 
satisfaction,  and  costs  associated  with  care. 
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Purpose  of  the  Study/  Problem 

Use  of  the  OAR  has  the  potential  to  promote  the  best  treatment  praetiees  in  eases  of 
BAT.  Use  of  the  OAR  has  the  potential  to: 

1 .  save  money  within  the  USAF  health  serviee  system, 

2.  minimize  treatment  delays, 

3.  inerease  aeeess  to  eare, 

4.  prevent  unneeessary  tests, 

5.  inerease  patient  eonfidenee  in  non-physieian  providers, 

6.  deerease  malpraetiee  liability  and, 

7.  provide  a  eost-effeetive  alternative  supporting  the  highest  standards  of  eare. 
Therefore,  the  purpose  of  the  proposed  study  is  to  determine  if  the  OAR  and/or  other 
elinieal  information,  tests  or  rules  are  being  utilized  by  aetive-duty  USAF  nurse 
praetitioners  (NPs)  and  physieian  assistants  (PAs)  to  determine  fraeture  in  eases  of  BAT. 
With  this  data,  the  investigator  will  extrapolate  the  potential  eost  savings  of  radiologie 
studies  not  olinieally  indieated  in  eaeh  of  a  number  of  written  ease  studies  presented  to 
volunteers  of  the  study. 

In  this  study,  a  questionnaire  eontaining  ease  seenarios  will  be  used  to  determine  to 
what  degree,  non-physieian  providers  prediet  fraeture.  Case  seenarios  will  be  developed 
under  a  review  panel  of  experts.  Blunt  ankle  trauma  ease  seenarios  will  eontain  essential 
eriteria  of  the  OAR  will  be  mailed  to  randomly  seleeted  providers.  Findings  of  this  study 
have  the  potential  to  demonstrate  reseued  fiseal  resourees  to  the  USAF  health  serviee 
system  and  demonstrate  potential  knowledge  defieit  of  health  eare  providers  treating 
BAT. 
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Research  Questions 


Researchers  who  engage  in  applied  research  concentrate  on  finding  a  solution  to  an 
immediate  problem  (Polit  &  Hungler,  1991).  The  use  of  case  study  scenarios  will  allow  a 
focused  look  at  BAT,  and  explore  the  demographics  of  two  groups  of  non-physician 
providers  in  the  USAF.  The  research  focus  of  this  study  is  to  determine  the  need  for  x- 
ray  in  case  scenarios  of  BAT  fracture  using  the  Ottawa  ankle  rules  as  a  clinical  practice 
guideline.  Hence,  the  study  asks  the  following  research  questions: 

1 .  Are  the  Ottawa  Ankle  Rules  clinical  guidelines  being  used  by  a  sample  of  active 
duty.  United  States  Air  Force  NPs  and  PAs? 

2.  Is  there  a  difference  in  the  selective  use  of  x-rays  in  case  scenarios  between  NPs 
and  PAs? 

3.  Is  there  a  theoretical  financial  benefit  to  using  the  Ottawa  Ankle  Rules? 

4.  What  clinical  information,  tests,  or  rules  are  used  to  determine  if  fracture  is 
present  in  written  cases  of  BAT? 

Conceptual  Framework 

Some  years  ago,  Albert  Einstein  said  in  an  address  to  the  California  Institute  of 
Technology: 

Concern  for  man  himself  and  his  fate  must  always  form  the  chief  interest  of  all 
technical  endeavors  in  order  that  the  creations  of  our  mind  shall  be  a  blessing  and 
not  a  curse  to  mankind.  Never  forget  this  in  the  midst  of  your  diagrams  and 
equations.  (Curtin,  1988,  p.  8) 

Health  care  providers  today  need  to  keep  abreast  of  a  changing  practice  environment 
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including  technological  advancements,  as  well  as  the  effeets  of  managed  care  on  their 
practice.  Advanced  practice  nurses  have  identified  the  knowledge  base  specific  to 
practice  and  are  an  expanded  role  for  nurses.  There  has  been  a  shift,  with  the 
development  of  clinical  practice  guidelines,  that  speaks  to  the  benefits  of  a  thorough 
clinical  assessment  using  what  is  available  within  the  patient/  provider  interaetion  to 
relieve  patient  suffering  (Epstein,  1990). 

King  (as  cited  in  George,  1990)  presents  an  open  systems  framework  and  the  nursing 
theory  identified  as  a  theory  of  goal  attainment.  King  s  (1981)  interest  is  in  the 
interaetion  of  individuals,  human  communieation  and  that  90  percent  of  information 
used  comes  from  nonverbal  behavior  and  about  7  percent  comes  from  verbal  cues  (p. 

71).  Central  to  the  use  of  elinical  praetiee  guidelines  is  having  a  patient-provider 
interaction  in  which  to  apply  the  guidelines.  Use  of  clinical  guidelines  are  aetions  both 
patient  and  the  advanced  practice  nurse  ean  eount  on  to  reduce  the  uncertainty  inherent  in 
medical  practice  by  defining  how  to  use  elinical  findings  to  make  predictions  on  goal 
attainment  in  the  context  of  shared  treatment  deeisions  (Wasson  &  Sox,  1996). 

Norman  Cousins  (1981)  asks  us  not  to  forget  the  vaunted  miraele  cures  that  abound 
in  the  literature  of  all  great  religions  all  say  something  about  the  ability  of  the  patient, 
properly  motivated  or  stimulated,  to  participate  actively  in  extraordinary  reversals  of 
disease  and  disability  (p.  47).  In  other  words.  Cousin  stresses  that  mueh  of  human 
suffering  is  self-limited  and  resolves  with  minimal  intervention. 

The  strength  of  King  s  Dynamic  Interacting  Systems  Model  (1971)  is  a  theory 
based,  open  systems  framework  that  supports  an  interpersonal  system,  interacting  in  an 
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environment  that  promotes  goal  attainment  (problem  treatment  and  resolution) 
(Aekerman,  et  ah,  1989).  In  this  model  two  individuals  eome  together  in  a  health  eare 
situation  to  develop  strategies  to  maintain  a  state  of  health  that  permits  a  return  to 
optimal  funetioning. 

King  (as  eited  in  George,  1990)  identifies  the  eoneeptual  framework  as  an  open 
systems  framework  and  the  theory  as  one  of  goal  attainment.  In  King  s  model, 
interaetion  between  elient  (patient  with  blunt  ankle  trauma)  and  provider  (nurse 
praetitioner  or  physieian  assistant)  is  based  on  the  aetions  of  eaeh  party  within  the 
interaetion.  This  in  turn  elieits  a  reaetion  from  eaeh  individual  in  the  dyad.  Those 
reaetions  eommingle  (interaetion)  and  a  transaetion,  or  goal  outeome  takes  plaee.  Her 
model  ineludes  important  eoneepts  of  a  praetiee  model  ineluding  pereeption, 
interpersonal  relations,  soeial  systems,  and  health  (Walker  &  Avant,  1988).  King  s 
emphasizes  the  importanee  of  pereeptions  and  the  need  for  the  nurse  to  be  alert  to  both 
elient  and  provider  personal  pereeptions.  This  idea  of  pereeption  is  similar  to  Leininger  s 
emphasis  on  eulture  and  its  effeets  on  the  delivery  of  nursing  eare  (George,  1990). 
Pereeptions  within  the  interaetion  are  an  important  aspeet  of  the  goal-setting  interaetions 
between  patient  and  provider. 

Though  King  s  foeus  is  on  the  nurse  ,  a  more  praetieal  term  health  eare  provider 
will  be  used  for  the  remainder  of  the  diseussion  of  her  eoneeptual  model.  The  Dynamie 
Interaeting  Systems  Model  (King,  1971)  is  eomposed  of  three  interaeting  systems:  (a) 
personal,  (b)  interpersonal  and,  (e)  soeial,  in  whieh  the  individual  eomprises  the  inner 
personal  system.  Individuals  interaet  to  form  dyads,  triads,  and  small  and  large  groups, 
whieh  eomprise  another  type  of  system  ealled  interpersonal  systems.  Groups  with  speeial 
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interests  and  needs  form  organizations,  whieh  make  up  eommunities  and  soeieties.  These 
groups  are  ealled  soeial  systems  (King,  1981,  p.  141). 

The  relevant  eoneepts  of  the  personal  system  are  pereeption,  self,  growth  and 
development,  body  image,  spaee  and  time.  Pereeption  is  aetion-oriented,  is  transaetional, 
and  suggests  pereeption  is  a  proeess.  An  individual  obtains  data  and  transforms  it.  The 
interpersonal  system  is  the  foeus  of  this  researeh.  This  obvious  relationship  is  formed  by 
human  beings  interaeting.  The  major  eoneepts  of  the  theory  of  goal  attainment  are 
interaetion,  eommunieation,  transaetion  role,  stress,  and  growth  and  development 
(Aekermann  et  ah,  1989;  George,  1990;  Meleis,  1991)  (See  Figure  1,  Patient  — 
Praetitioner  Interaetion  Coneept  Diagram). 

Nursing  as  a  seienee  historieally  has  borrowed  non-nursing  theory  to  explore 
phenomena  (Meleis,  1991).  Applying  King  s  (1981)  theory  to  the  eurrent  study 
addresses  nursing  eare  in  the  administration  of  direet  patient  eare  and  has  an  applieation 
to  both  nurse  praetitioners  and  physieian  assistants.  King  addresses  the  four  major 
eoneepts  eentral  to  nursing  theory.  If  a  provider  is  to  help  the  BAT  patient,  he  or  she 
should  eonsider  more  than  just  the  question  of  is  the  ankle  is  fraetured  or  not?  What 
pereeptions  do  the  patient  and  provider  bring  to  the  interaetion?  Why  is  the  patient 
seeking  eare  and  what  expeetations  does  the  patient  bring  to  the  interaetion?  As  a 
provider,  what  is  the  standard  of  eare  for  individuals  seeking  eare  with  similar  symptoms 
of  pain,  tenderness  at  a  speeifie  site  on  the  body  (health,  environment/soeiety)?  Finally, 
what  ean  the  provider  do  to  satisfy  the  patient  s  needs  relating  to  pain  and  altered 
funetioning? 

King  (1981)  feels  nurses  (providers)  have  a  responsibility  to  edueate  and  share 
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information  (the  Ottawa  Ankle  Rules)  that  helps  individuals  make  informed  ehoiees 
about  health  care.  Further,  King  says  nurses  are  concerned  with  human  beings, 
interacting  with  their  environment  in  ways  that  lead  to  self-fulfillment  and  to 
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Patient  —  Practitioner  Interaction  Concept  Diagram  Adapted  from  J.B.  George,  Nursing 
Theories:  The  Basis  for  Professional  Nursing  Practice,  Imogene  M.  King,  Englewood 
Cliffs,  NJ:  Prentice-Hall,  1990,  p.  200. 


maintenance  of  health  (p.  49).  King  presents  an  open  systems  framework  from  which 
she  has  derived  a  theory  of  goal  attainment.  The  three  sub-systems  of  the  model 
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(personal,  interpersonal,  and  social)  are  all  in  continuous  exchange  with  their 
environment.  From  this  open  systems  framework  King  has  derived  a  theory  of  goal 
attainment.  The  three  sub-systems  of  the  model  are  all  in  continuous  exchange  with  their 
environment.  They  may  function  optimally  in  their  roles. 

King  (1981)  believes  a  goal  of  providers  is  to  help  individuals  improve  their  health 
so  they  may  function  optimally  in  their  roles.  In  order  for  goals  to  be  attained,  it  is 
important  that  the  provider  and  patient  perceive  each  other,  the  situation,  and 
communicate  information.  If  this  does  not  occur,  transactions  are  not  made,  and  goals 
cannot  be  achieved.  Practice  guidelines  support  the  relationship  and  promote  optimal 
patient  care.  Developed  and  proven  guidelines  and  decision  rules  are  standards  of  care 
that  assist  the  provider  in  providing  efficient,  safe  and  effective  care  (Ellwood,  1988; 
Weingarten,  1997). 

Since  the  1980s,  an  important  development  in  American  medicine  has  been  the  role 
of  clinical  practice  guidelines,  or  prediction  rules.  Clinical  prediction  rules  specify  for 
providers  the  proper  indications  for  performing  medical  procedures  and  treatments  and 
the  proper  management  of  specific  clinical  problems.  Clinical  rules  are  intended  to  help 
physicians  interpret  clinical  information  (Wasson,  Sox,  Neff,  &  Goldman,  1985,  p.  793). 
Medicine  has  entered  an  era  of  unprecedented  growth  in  activity  directed  at  the 
assessment  of  outcomes,  the  analysis  of  effectiveness,  and  quality  assurance  measures. 
Clinical  practice  guidelines  are  an  important  innovation  to  improve  the  quality  of  care  by 
defining  appropriate  clinical  practice  (Sox  &  Woolf,  1993).  Paul  Elwood  (1988),  who 
popularized  the  concept  of  health  maintenance  organizations,  has  called  for  a  major 
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initiative  in  what  he  terms  outeomes  management  ■  a  national  program  in  whieh  clinieal 
standards  and  guidelines  are  based  systematieally  on  patient  outcomes. 

In  1990,  in  line  with  this  notion,  the  federal  government,  through  the  Agency  for 
Health  Care  Policy  and  Research,  launched  a  program  directed  at  developing  guidelines 
for  medical  practice  through  the  assessment  of  patient  outcomes  (Epstein,  1990).  Greco 
and  Eisenberg  (1993)  report  clinical  practice  guidelines  have  gained  popularity  as  a 
means  of  influencing  physicians  practices  (p.  1271)  but  add  that  physicians  are  upset 
due  to  the  intrusion  of  external  constraints  (like  guidelines).  To  be  effective,  guidelines 
must  be  used.  They  are  currently  used  increasingly  in  practice  and  since  hundreds  of 
practice  guidelines  are  anticipated  in  the  coming  years,  family  physicians  should  become 
informed  consumers  of  guidelines,  avoid  accepting  them  on  face  value,  and  ask  specific 
questions  to  judge  their  quality  (Woolf,  1995,  p.  1455). 

The  treatment  providers  apply  in  cases  of  BAT  involve  subjective  and  objective 
elements.  Each  element  is  essential  in  the  decision  whether  or  not  to  x-ray  in  cases  of 
BAT.  The  objective  element  consists  of  weighing  potential  outcomes,  benefits  and  harms 
of  the  various  options,  and  determining  how  likely  each  is  to  occur.  Doing  so  requires 
adequate  training  to  understand  options  and  having  a  command  of  the  current  data  on  the 
magnitude  or  probability  of  potential  benefits  and  harms.  This  task  is  made  easier 
through  the  use  of  the  Ottawa  Ankle  Rules. 

In  congress  with  the  patient,  the  provider  must  decide  whether  or  not  to  obtain  a  x- 
ray  in  cases  of  BAT.  Some  patients  dislike  ambiguity  when  it  comes  to  their  medical 
care  (Woolf,  1997).  McLain  (1988)  says  Nursing  is  a  profession  equipped  with  the 
interest  in  and  skill  for  creating  environments  conducive  to  open  communication  (p.  38). 
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Creating  a  provider-patient  partnership  has  been  shown  to  improve  patient  satisfaetion 
and  eomplianee  in  psychiatry,  the  social  sciences,  and  in  primary  care  (Molde  &  Diers, 
1985).  Woolf  (1997)  reports  the  long  tradition  of  medical  paternalism  must  now  be 
tempered  with  the  notion  of  allowing  patients  to  express  their  wishes  for  treatment  and 
shared  decision-making.  The  OAR  support  a  shared  experience  and  a  discussion  of 
goals;  the  provider  is  able  to  discuss  with  the  patient  why  or  why  not  a  radiologic  study  is 
required.  The  OAR  do  not  discount  patient  feelings  or  support  the  notion  of  cookbook 
medicine  .  The  patient  enters  the  interaction,  in  partnership  with  the  provider,  often  with 
the  expectation  of  pain  relief  and  to  rule  out  fracture.  Using  a  decision  rule  like  the  OAR 
clinical  guidelines  supports  the  clinical  diagnosis  and  the  use  of  further  diagnostic  study. 
Providers  dissatisfied  with  the  practice  of  medicine  because  of  constraints  on  practice 
need  not  worry  about  the  intrusiveness  of  the  OAR.  The  Ottawa  Ankle  Rules  are 
intended  to  assist  the  clinician  in  the  formulation  of  an  accurate  diagnosis. 

The  necessity  of  accurate  assessment  and  accountability  are  part  of  a  safe  standard  of 
care.  The  OAR  produce  more  rational,  logical,  and  efficient  care.  Clinical  guidelines 
like  the  OAR  should  replace  the  defensive  x-ray  examinations  which  have  been 
estimated  to  be  used  in  30%  of  all  cases  where  x-rays  were  obtained  (Abrams,  1979,  p. 
1214).  Hale  (1996)  supports  the  use  of  defensive  medicine  by  saying  anyone  who  has 
been  in  practice  for  a  while  knows  that  the  reason  we  take  these  x-rays  is  legal,  not 
medical  (p.  363).  Joshi  (1995)  reports  that  In  this  decade  of  increasing  litigation,  many 
clinicians  faced  with  acute  ankle  and  foot  trauma  automatically  take  radiographs  in 
search  of  occult  fractures  (p.  152).  This  practice  raises  costs  and  causes  substantial 
delays  in  care.  Another  study  went  so  far  as  to  extrapolate  legal  costs  for  missed  fracture 
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litigation  (Anis  et  al.,  1995).  Use  of  the  OAR  as  a  elinieal  guideline,  helps  to  ensure  the 
provider  is  proteeted  against  eharges  of  malpraetiee. 

Clinieians  always  faee  missing  a  elinieal  elue  and  eonfronting  a  malpraetiee  suit. 
Brand  and  eolleagues  (1982)  note: 

A  physieian  who  fails  to  obtain  an  x-ray  examination  out  of  earelessness  eould  be 
held  negligent  if  harm  resulted,  but  omission  of  an  x-ray  study  on  the  basis  of 
seleetivity  in  ordering  diagnostie  tests  is  not  negligent,  provided  that  the  doetor  s 
deeision  is  eonsistent  with  the  patient  s  elinieal  presentation. 

A  physieian  eannot  be  found  liable  for  an  ineorreet  diagnosis  unless  the  patient 
suffers  damage  as  a  result,  (p.  338) 

Collaborative  implementation  of  these  deeision  rules  in  eases  of  BAT  by  a  variety  of 
providers  ean  only  enhanee  the  effeetiveness  and  sueeess  of  the  primary  eare  of  patients 
entering  the  USAF  health  serviee  system. 

Health  eare  is  a  serviee  industry.  As  providers  in  this  industry,  advaneed  praetiee 
nurses  are  earegivers  to  individuals  (or  individuals  and  their  families).  Their  primary 
foeus  will  be  in  ensuring  patients  reeeive  the  eare  they  need  (Gebbie,  1997).  Cost  is  a 
neeessary  faetor  in  health  eare  delivery,  but  it  should  not  be  the  sole  indieator  in  outeome 
management.  In  today  s  world  of  eost-eonseious  medieine,  however,  it  may  be  useful  to 
evaluate  ankle  injuries  aeeording  to  the  Ottawa  Ankle  Rules  (Wexler,  1998).  Obtaining 
high-yield  x-rays  at  the  proper  time  through  the  use  of  the  OAR  may  in  theory  save 
money  for  the  USAF  health  serviee  system. 

It  has  been  estimated  that  ankle  x-rays  eost  an  estimated  500  million  dollars  in  the 
United  States  (US)  and  Canada  (Anis  et  al.  1995;  Shell,  1996).  Miehelson  et  al.  (1995) 


15 


report  that  reducing  follow-up  x-rays  in  cases  of  ankle  fracture  could  save  over  35  million 
dollars  in  the  US  per  year.  Anis  et  al.  (1995)  report  the  use  of  the  OAR  could  result  in 
US  savings  of  $7.45  to  $32.92  which  varied  according  to  the  rate  of  missed  fractures, 
costs  of  radiography,  probability  of  lawsuits,  and  costs  of  lawsuits  (p.  442).  The  British 
Columbia  Medical  Association  (1998)  reports  that  the  OAR  could  reduce  the  number  of 
annual  ankle  x-rays  by  20%  (http://  www.hlth.gov.be).  A  multicenter  trial  in  Ontario, 
Canada  (Stiell  et  ah,  1995)  reports  use  of  the  OAR  decreased  appropriate  x-ray  use  by 
26%.  One  must  also  consider  the  indirect  cost  of  BAT.  Rigler  (1976)  says  once  a 
radiograph  has  been  made,  regardless  of  how  unnecessary  it  must  be  examined  and 
interpreted  this  may  happen  several  times  (p.  449).  Studies  demonstrate  patients  with 
no  radiography  spent  less  time  in  the  emergency  department  and  had  lower  medical 
charges  (Stiell  et  ah,  1995;  Stiell,  McKnight,  et  ah,  1994).  For  this  study,  cases  of 
inappropriate  x-ray  decision  will  be  divided  into  total  possible  cases  of  x-rays,  then 
multiplied  by  the  average  cost  of  an  x-ray  (or  series)  to  achieve  a  theoretical  cost  savings. 

Conceptual  and  Operational  Definitions 

For  the  purpose  of  this  study,  the  following  definitions  will  be  used: 

Health  Care  Providers. 

All  physician  assistants  (PA)  and  all  nurse  practitioners  (NP)  in  active  duty  service 
in  the  United  States  Air  Force. 

Blunt  Ankle  Trauma  (BAT)  Cases. 

Written  cases,  reviewed  by  a  panel  of  experts,  containing  specific  clinical  criteria  of 
the  Ottawa  Ankle  Rules.  Blunt  ankle  trauma  can  occur  through  a  variety  of  mechanisms 
but  typically  results  in  forced  inversion  of  the  foot;  forced  dorsiflexion  of  the  foot,  or 
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external  rotation  and  abduetion.  This  meohanieal  motion  may  result  in  a  simple  sprain  or 
may  be  as  serious  as  a  olinioally  signifieant  fraeture  (Rizzolo,  1993;  Siekles,  1997). 
Clinieal  Praetiee  Guideline. 

An  offieial  statement  that  outlines  how  to  prevent,  diagnose  and/or  treat  speeifie 
medieal  eonditions  and  how  to  perform  eertain  olinieal  proeedures,  often  used  as  an 
adjunet  to  sound  olinioal  judgement.  Clinieal  praetiee  guidelines  are  also  known  as 
praetiee  parameters,  elinieal  polieies,  standards,  treatment  protoeols,  appropriateness 
eriteria  and  other  elosely  related  terms.  They  are  intended  to  help  elinieians  interpret 
elinieal  information  (Wasson,  Sox,  Neff,  &  Goldman,  1985;  Weingarten,  1997;  Woolf, 
1995). 

Ottawa  Ankle  Rules  (Guidelines  For  Radiography  of  the  Ankle  and  Foot). 

A  set  of  systematieally  developed  rules  to  assist  a  health  eare  provider  determine  the 
use  of  radiography  in  ankle  or  foot  injury  (Stiell,  MeKnight,  et  al.,  1994). 

The  Ottawa  Ankle  Rules  do  not  apply  in  oases  of:  Persons  less  than  18  years  of  age, 
intoxioation,  multiple  painful  injuries,  pregnanoy,  head  injury,  or  diminished  sensation 
due  to  neurologioal  defioit.  The  Ottawa  Ankle  Rules  provide  reoommendations  where  a 
oareful  assessment  shows  blunt  ankle  trauma,  or  twisted  ankle: 

1 .  Ankle  x-rays  are  required  if  there  is  any  pain  in  the  malleolar  zone,  and  any  one 
of  these  findings: 

•  Bone  tenderness  along  the  distal  6  oentimeters  (om)  of  the  posterior  edge  of  the 
fibula  or  tip  of  the  lateral  malleolus. 

•  Bone  tenderness  along  the  distal  6  om  along  the  posterior  edge  of  the  tibia  or  tip 
of  the  medial  malleolus. 
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•  Inability  to  bear  weight  for  four  steps  both  immediately  and  in  the  emergeney 
department  (within  the  first  hour  following  the  injury). 

2.  Foot  X-rays  are  only  required  if  there  is  any  pain  in  the  midfoot  zone,  and  any 
one  of  these  findings: 

•  Bone  tenderness  over  the  navieular 

•  Bone  tenderness  over  the  base  of  the  5th  metatarsal 

•  Inability  to  bear  weight  for  four  steps  both  immediately  and  in  the  emergeney 
department  (within  the  first  hour  following  the  injury). 

Assumptions  and  Limitations 

The  OAR  have  been  validated  and  found  to  be  speeifie  for  fraeture  in  events  of 
BAT.  The  Ottawa  Ankle  Rules  Projeet  presented  by  Stiell(1996)  demonstrated  that  more 
than  95%  of  patients  with  ankle  injuries  had  x-rays,  but  that  85%  of  the  fdms  showed  no 
fraeture.  Refinement  and  validation  have  shown  the  OAR  to  be  100  %  sensitive  for 
fraeture;  to  be  reliable,  and  to  have  the  potential  to  allow  providers  to  safely  reduee  the 
number  of  radiographs  ordered  in  patients  with  ankle  injuries  (Stiell  et  ah,  1993).  The 
primary  assumption  is  that  elinieians  are  unaware  of  the  OAR  and  use  other  non-speeifie 
elinieal  data  to  determine  if  fraeture  is  present. 

A  sample  of  non-physieian  providers  may  demonstrate  elinieal  differenees  in  their 
abilities  in  determining  fraeture.  Nurse  praetitioners  and  physieian  assistants  reeeive 
varying  levels  of  formal  edueation,  and  differenees  exist  in  preparation  and  praetieal 
experienee.  Non-physieian  providers  are  being  utilized  with  inereasing  frequeney  in  the 
USAF  health  serviee  system.  By  examining  two  groups  (nurse  praetitioners  and 
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physician  assistants),  comparisons  can  be  made  between  the  two  groups,  eomparing  how 
eaeh  individual  within  that  group  assesses  BAT.  Then  eaeh  group  as  a  whole  ean  be 
eompared  as  to  their  ability  to  assess  BAT  using  a  deseriptive  design,  ease  study  seenario 
approaeh. 

This  study  was  limited  by  eonstraints  of  time  and  fiseal  resourees.  The  researeher  is 
enrolled  in  full-time  graduate  study  and  as  sueh,  this  study  in  part  fulfills  the 
requirements  of  a  master  of  seienee  in  nursing.  The  goal  was  to  have  a  large  enough 
sample  to  determine  signifieanee,  but  not  large  enough  to  be  prohibitive  in  terms  of  eost 
or  time.  Statistieal  support  and  software  was  available  to  the  researeher  and  was 
adequate  to  implement  this  researeh. 

Summary 

Ankle  injuries  are  frequent,  as  are  the  radiologie  tests  aeeompanying  their 
assessment.  In  most  instanees,  x-rays  are  done  on  ankles  without  fraeture,  for  a  variety  of 
reasons;  exposing  the  system  to  exeessive  eosts,  time  delays,  and  patient  dissatisfaetion 
with  outeomes.  The  OAR  is  an  example  of  olinieal  praetiee  guidelines  that  are  benefieial 
in  some  populations.  This  study  proposes  to  answer  researeh  questions  using  ease 
seenarios  relevant  to  the  OAR.  King  provides  a  suitable  framework  to  evaluate 
adherenee  to  praetiee  guidelines. 
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CHAPTER  TWO:  LITERATURE  REVIEW 


History  and  Physical  Anatomy 

Since  the  time  of  Hippocrates,  lesions  of  the  ankle  were  diagnosed  chiefly  as 
luxations.  In  the  eighteenth  eentury  Freneh  and  English  elinieal  literature  ealled  attention 
to  the  serious  nature  of  ankle  lesions  and  the  diffieulty  in  treatment.  Most  ankle 
treatments  at  that  time  invariably  led  to  varying  degrees  of  disability.  It  was  not  until  the 
early  20th  century  soon  after  the  introduetion  of  x-rays  (then  roentgenogram  )  in  elinieal 
work,  that  fraetures  of  the  ankle  were  interpreted  as  a  form  of  primary  injury  in  serious 
oases  of  lesions  of  the  ankle  (Lauge,  1948). 

Ankle  injuries  are  desoribed  aooording  to  anatomio  desoriptions  suoh  as,  medial 
malleolar  fraoture,  lateral  malleolar  fraoture,  bimalleolar  fraoture,  etc..  However, 
appreoiating  the  meohanism  of  injury  allows  one  to  antioipate  unexpeoted  pathology,  i.e., 
the  possibility  of  ligamentous  injury  or  fraoture  not  otherwise  apparent  on  x-ray  (Dias, 

&  Foerster,  1974,  p.  219).  Classifying  ankle  injury  is  an  important  part  of  the  diagnostio 
process  for  without  olassifioation,  the  relation  of  one  lesion  to  another  oan  be  neither 
remembered  nor  understood  in  any  department  of  knowledge;  oomprehension  is  a 
prerequisite  for  intelligent  memory  and  for  rational  diagnosis  and  treatment  (p.  219). 
Sprains  are  one  of  the  most  eommon  injuries  seen  by  primary  care  physicians  (Sickles, 
1997).  Bearing  this  thought  in  mind,  how  does  a  provider  differentiate  fracture,  sprain,  or 
an  unstable  ankle  mortise  joint  based  on  either  of  these  eonditions?  The  answer  lies  in  a 
thorough  history  including  the  mechanism  of  injury  and  a  complete  physieal  exam  of  the 
ankle  and  foot. 
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Functionally,  the  foot  can  be  eompared  to  the  pronated  hand.  The  soft  structures  of 
the  hand  and  foot  are  similar  in  many  details,  and  the  bony  strueture  is  fundamentally 
similar,  but  modified  in  the  foot  because  of  its  weight-bearing  duties.  The  primary 
funetion  of  the  foot  is  to  provide  a  stable  platform  of  support  to  attenuate  impaet  loading 
of  the  extremity  during  loeomotion,  and  to  assist  in  the  efficient  forward  propulsion  of 
the  body  (Gross,  Fetto,  &  Rosen,  1996).  Struetural  integrity  of  the  foot  is  dependent  on 
the  combination  of  articular  geometry  and  soft-tissue  support  (Gross  et  al,  1996;  Stover, 
1980).  To  manage  these  funetions,  the  foot  bone  has  26  bones.  The  talus  bone  (ankle 
bone)  is  the  only  bony  link  between  the  leg  and  the  foot. 

Rizzolo  (1993)  provides  a  thorough  deseription  of  the  funetional  anatomy  of  the 
eomplex  structure  of  the  ankle,  formed  by  three  bones  and  two  groups  of  ligaments.  The 
distal  end  of  the  tibia  and  fibula  form  into  an  areh  into  whieh  the  talus  artieulates  (the 
mortise).  Collateral  ligaments  stabilize  the  joint,  preventing  eversion  and  inversion  while 
allowing  plantar  flexion  and  dorsiflexion.  Tendons  loosely  provide  seeondary  support. 
The  external  (lateral)  collateral  ligament  (LCL)  eonsists  of  three  separate  elemental 
ligaments.  The  LCL  s  are  relatively  lax  and  allow  for  eonsiderable  internal  rotation  of 
the  foot  and  are  the  most  eommonly  affeeted  in  ankle  injury  as  the  result  of  forceful 
inversion.  The  medial  (deltoid)  ligaments  of  the  ankle  joint  are  taut,  and  allow  mueh  less 
motion  than  do  the  lateral  ligaments.  The  motion  of  the  ankle  joint  ineludes  flexion- 
extension  and  anterior-posterior  glide.  Due  to  the  eomplexities  of  the  synovial 
articulations  within  the  structure  of  ankle,  the  ankle  is  generally  considered  the  most 
eommonly  injured  joint  and  a  frequent  eause  of  morbidity  in  the  general  population 
(Prokuski,  &  Saltzman,  1997;  Sujitkumar  et  ah,  1986;  Wexler,  1998). 
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When  getting  a  history  it  is  important  to  elueidate  the  meehanism  of  injury. 
Diseovery  of  the  injury  meehanism  allows  the  elinieian  to  hunt  for  suspeet  lesions  in  an 
anatomie  zone.  Observe  how  the  individual  walks  (limps?)  into  the  exam  area.  A 
thorough  examination  ineludes  inspeetion,  bony  and  soft  tissue  palpation,  neurologie 
evaluation,  tests  for  joint  stability,  range  of  motion  (ROM)  and  any  other  additional 
speeial  tests  (Hoppenfield,  1976).  The  patient  should  be  inspeeted  in  a  sitting,  non- 
weight-bearing  position,  as  well  as  standing  and  walking  (if  tolerated).  Both  feet  and 
ankles  should  be  examined.  The  toes  should  point  straight  forward  and  lie  flat.  Normally 
the  skin  is  smooth;  shiny  over  either  malleoli.  There  should  be  a  longitudinal  areh,  but 
flat  feet  are  a  normal  variant.  The  transverse  areh  of  the  foot  is  loeated  immediately 
behind  the  metatarsal  heads  (Hoppenfield,  1976).  The  joint  spaees  of  the  ankle  should  be 
smooth  and  depressed,  with  no  fullness,  welling,  or  tenderness  (Jarvis,  1996). 

The  basie  ankle  and  foot  motions  are:  (a)  ankle  motions  of  dorsiflexion  and  plantar 
flexion,  (b)  subtalar  motion  of  inversion  and  eversion,  (e)  midtarsal  motion  of  forefoot 
adduetion  and  abduetion  and,  (d)  toe  motion  of  flexion  and  extension  (Hoppenfield, 

1976).  Normal  ROM  should  inelude:  (a)  dorsiflexion  ~20  degrees,  (b)  plantar  flexion~45 
degrees,  (e)  inversion  ~30  degrees,  and  (d )  eversion  ~20  degrees.  Aeeording  to  Jarvis 
(1996)  examine  the  patient  for  limited  ROM  or  pain  with  motion.  Observe  the  patient  by 
noting  the  response  to  speeifie  eommands  (p.  679)  (See  Table  1). 

Range  of  motion  ean  be  inhibited  giving  the  elinieian  elues  as  to  the  eause  of  the  loss 
of  funetion.  Fore,  aft,  or  side-to-side  motion  may  be  restrieted  due  to  swelling,  whieh 
restriets  ROM.  Limited  dorsiflexion  may  be  due  to  intermalleolar  narrowing  (The  wider 
portion  of  the  talar  head  will  not  fit  into  the  mortise). 
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Tests  for  ankle  joint  stability  in  oases  of  blunt  ankle  trauma  (BAT),  should  include 
the  anterior  drawer  test,  talar  tilt  testing  and  a  full  ROM  series  examining  the  relative 
laxity  of  the  joint  (Hoppenfield,  1976).  A  thorough  exam,  including  the  use  of  the 
Table  1 


Patient  Instruction  and  Expected  Movement 


Patient  Instruction 

Motion  and  Expected  Range 

Point  toes  toward  the  floor 

Plantar  flexion  of  45  degrees 

Point  toes  toward  your  nose 

Dorsiflexion  of  20  degrees 

Turn  soles  of  feet  out,  then  in  (stabilize  the  ankle 

Eversion  of  20  degrees 

with  one  hand,  hold  heel  with  the  other  to  test  the 

Inversion  of  30  degrees 

subtalar  joint). 

Flex  and  straighten  toes. 

Maintain  dorsiflexion  and 
plantar  flexion  against 
resistance. 

Adapted  from:  S.  Hoppenfield,  Physical  Examination  of  the  Spine  &  Extremities, 
Norwalk,  CT:  Appleton  &  Eange,  1976,  pp.  223-226;  C.  Jarvis,  Physical  Examination 
and  Health  Assessment,  Philadelphia:  W.B.  Saunders,  1996,  pp.  678-679. 

Ottawa  Ankle  Rules  (OAR),  will  assist  the  clinician  in  making  a  determination  as  to  the 
functional  status  of  the  ankle  mortise  and  foot.  A  complete  exam  directs  the  plan  for 
action  and  treatment  plan. 
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Clinical  Decision  Rules  -  When  to  Get  an  X-ray 

The  ankle  ranks  with  the  knee  and  shoulder,  among  the  three  anatomie  regions  most 
eommonly  injured  (Daffner,  1994;  Siekles,  1997;  Stover,  1980).  Most  ankle  injuries  ean 
be  treated  in  the  offiee,  although  more  serious  injuries  should  be  referred  to  an  orthopedie 
serviee  (Wexler,  1998).  Sprains  of  the  ankle  are  eommon  injuries,  and  the  major  ankle 
problem  treated  by  most  primary  eare  praetitioners.  Ankle  x-rays  aeeount  for  about  2-3% 
of  all  radiologie  examinations  and  about  10%  of  those  performed  in  emergeney  rooms 
(Sujitkumar  et  ah,  1986;  Tandeter  &  Shvartzman,  1997;  Trevino  et  ah,  1994).  Signifieant 
is  the  faet  that  less  than  15%  of  ankle  injuries  are  found  to  result  in  signifieant  fraeture 
(Stiell,  MeKnight,  et  ah,  1992;  Tandeter  &  Shvartzman,  1997;  Vargish,  Clarke,  Young,  & 
Jensen,  1983;  Wexler,  1998).  Trevino  and  eolleagues  (1994)  report  the  ineidenee  of 
inversion  injuries  is  estimated  at  1  per  10,000  persons,  per  day.  Frykberg  (1996)  states 
that  lateral  ankle  sprains  of  the  lateral  eollateral  ligaments  are  the  usual  presentation, 
sinee  medial  sprains  of  the  deltoid  ligament  are  frequently  aeeompanied  by  lateral  ankle 
fraetures  (p.  1078). 

Beeause  of  the  variety  of  ankle  injuries,  praetitioners  need  a  valid  tool  to  assist  in  the 
deeision  whether  or  not  to  obtain  an  x-ray.  Tandeter  and  Shvartzman  (1997)  write  that 
fraetures  may  be  assoeiated  with  severe  ligament  injuries,  but  avulsion  ean  happen  before 
a  ligament  is  torn  ....  Physieians  usually  eonsider  it  mandatory  to  obtain  a  radiograph 
of  every  injured  ankle  even  though  the  vast  majority  of  these  films  show  no  evidenee  of 
signifieant  bone  injury  (pp.  2272,  2274-2275). 

The  routine  use  (overuse)  of  ankle  radiographs  is  debatable  (Abrams,  1979; 
Montague  &  MeQuillan,  1985;  Stiell,  1996;  Stiell,  MeDowell,  et  ah,  1992;  Verma  et  al. 
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1997;  Wexler,  1998).  Rizzolo  (1993)  suggests  that  the  uses  of  x-rays  are  not  neeessary 
for  most  ankle  injuries.  Clinieal  observation  and  treatment  of  blunt  ankle  and  foot 
injuries  leading  to  diseovery  of  signifieant  fracture  have  led  to  the  development  of 
objective  screening  guidelines  for  the  prediction  of  fractures.  As  part  of  the  interaction 
between  provider  and  patient,  the  provider  would  find  it  helpful  to  have  some  guideline 
to  direct  when  to  x-ray  in  cases  of  BAT. 

Clinical  variables  have  been  studied  for  the  prediction  of  fractures  versus  soft  tissue 
injuries  of  the  ankle.  DeLacey  and  Bradbrooke  (1979)  retrospectively  reviewed  x-ray 
films,  casualty  cards  and  notes  of  100  consecutive  patients  in  the  accident  department  of 
a  British  hospital.  Their  study  was  based  on  earlier  work  that  suggested  the  simple 
maxim  no  swelling  adjacent  to  a  malleolus,  no  radiographs  (p.  1597).  DeLacey  and 
Bradbrooke  found  65%  of  ankle  injuries  without  swelling  did  not  have  fracture,  and  99% 
(92  of  93)  patients  with  a  major  fracture,  had  soft  tissue  swelling  at  the  level  of  the 
malleoli.  In  32%  of  all  cases  (100),  ankle  radiographs  had  been  performed,  but  only  3 
foot  injuries  were  found.  To  summarize,  local  swelling  and  point  tenderness  are  valid 
high-yield  criteria  for  the  presence  of  fractures  in  injured  ankles.  The  authors  concluded, 
a  radiograph  will  not  be  helpful  in  an  adult  who  presents  with  an  acute  ankle  injury  and 
has  no  swelling  specifically  adjacent  to  either  malleolus  (p.  1598). 

Brand  et  al.  (1983)  developed  one  of  the  first  documented  protocols  for  use  in 
injured  extremities,  of  which  the  evaluation  of  the  ankle  was  included.  The  developed 
protocol  only  missed  one  in  287  fractures.  Eight  hundred  sixty  four  patients  were  seen 
during  the  first  two  years  of  the  4-year,  two-phase  study  (protocol  development  and  then 
evaluation).  Clinical  discriminators  were  identified,  and  a  step-wise  procedure  (X^, 


25 


p=0.05)  using  Chi-square  statistics  led  to  combining  variables  ended  when  inclusion  of  a 
variable  failed  to  improve  predictive  accuracy.  The  developed  protocol  was  tested  the 
next  two  years.  The  results  of  the  study  attested  to  the  safety  of  using  a  protocol  in 
conjunction  with  careful  physical  examination.  The  study  demonstrated  that  it  is  possible 
to  reduce  the  use  of  radiography  while  maintaining  a  high  standard  of  quality  and  safety. 

Recognizing  x-ray  was  rapidly  superseding  clinical  examination  in  cases  of  ankle 
injury,  Vargish  et  al.  (1983)  developed  a  working  list  of  clinical  indicators  to  assist  in  the 
differentiation  of  soft  tissue  injury  versus  fracture.  Over  a  brief  period,  150  patients  of  a 
convenient  sample  (no  institution  mentionedjwere  examined  using  an  assessment  form. 
Chi-square  analysis  (p=0.05)was  performed  on  each  variable.  Of  the  150  patients 
assessed  in  the  study,  nineteen  (12.7%)  had  fractures  and  one  hundred  thirty  one  (87%) 
had  soft  tissue  injuries.  The  patient  s  ability  to  bear  weight  and  the  presence  of  point 
tenderness  over  the  lateral  aspect  of  the  ankle  below  the  malleolus  proved  to  be  helpful 
clinical  points.  This  study  also  suggested  that  careful  patient  assessment  permitted  the 
discriminate  use  of  ankle  x-rays.  The  work  of  DeLacey  and  Bradbrooke  (1979), 
combined  with  Vargish  and  colleagues  (1983)  proved  to  be  the  basis  of  what  came  to  be 
known  as  the  Ottawa  Ankle  Rules  (OAR). 

Ottawa  Ankle  Rules 

Work  such  as  previously  noted  continued  into  the  1990  s  (Cocksott  et  ah,  1983; 
Dunlop,  Beattie,  White,  Raab,  &  Doull,  1986;  Gleadhill,  Thomson,  &  Simms,  1987; 
Matthews,  1986;  Sujitkumar  et  ah,  1986;  Warren,  &  Ferguson,  1984).  Shell,  McDowell 
and  colleagues  (1992)  presented  a  two-stage  study  examining  the  attitudes  and 
judgements  of  experienced  clinicians  in  their  use  of  ankle  radiography  and  to  assess  the 
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potential  for  improved  effieieney.  The  findings  of  this  original  researeh  suggested  great 
potential  for  a  more  effieient  use  of  radiography  in  patients  with  ankle  injury  through 
the  use  of  guidelines  (p.  1671),  later  referred  to  as  the  Ottawa  Ankle  Rules.  The  OAR 
are  a  set  of  deeision  rules  to  determine  if  an  x-ray  is  needed  in  the  ease  of  non-pregnant 
adults  who  have  experieneed  BAT.  It  ineludes  a  standardized  pieture  (Stiell,  MeKnight, 
et  ah,  1994)  of  the  foot  and  ankle  with  a  malleolar  zone  and  a  midfoot  zone.  Based  on 
this  pieture  the  rules  are  listed  below: 

An  ankle  x-ray  series  is  only  required  if  there  is  any  pain  in  malleolar  zone  and  any 
of  these  findings: 

1 .  Bone  tenderness  at  the  posterior  edge  or  tip  of  lateral  malleolus  (3  eentimeters 
[em]  proximal  and/or  distal),  or 

2.  Bone  tenderness  at  posterior  edge  or  tip  of  medial  malleolus  (3  em  proximal 
and/or  distal),  or 

3.  Inability  to  bear  weight  both  immediately  and  in  the  emergeney  department. 

A  foot  x-ray  series  is  only  required  if  there  is  any  pain  in  midfoot  zone  and  any  of 
these  finding: 

1 .  Bone  tenderness  at  the  base  of  the  5th  metatarsal,  or 

2.  Bone  tenderness  at  the  navieular  bone,  or 

3.  Inability  to  bear  weight  both  immediately  and  in  emergeney  department. 

(p.  828). 

These  guidelines  were  further  used  to  eonduet  a  prospeetive  study  of  patients 
presenting  with  BAT  in  the  ED  s  of  two  Canadian  university  hospitals.  The  study  was 
eondueted  in  1990  over  a  period  of  six  months.  In  the  study  (Stiell,  Greenberg  et  ah. 
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1992),  32  clinical  variables  were  assessed  and  reeorded  on  data  sheets  prior  to 
radiography.  Variables  were  measured  for  reliability  and  assoeiation  with  signifieant 
fracture  on  both  ankle  and  foot  radiograph  series.  The  results  of  the  main  study 
eoneluded  the  OAR  were  100%  sensitive  and  40%  speeifie  for  malleolar  fraetures  and,  if 
used,  would  reduce  ankle  x-rays  36%.  All  32  midfoot  fraetures  were  identified  through 
the  use  of  the  OAR. 

Stiell,  MeKnight  and  eolleagues  (1994)  reported  on  the  suecessful  implementation  of 
the  OAR  in  a  nonrandomized,  eontrolled  trial  eomparing  rates  of  ankle  and  foot  x-ray 
series  before  and  after  intervention.  All  adult  patients  reporting  to  two  Canadian 
university  hospitals  with  aeute  blunt  ankle  trauma  were  ineluded  in  this  study  of  2,342 
patients.  Persons  completing  the  data  form  ineluded  experieneed  physieians  as  well  as 
house  offieers.  One  hospital  served  as  eontrol  and  the  intervention  hospital  used  the 
OAR.  This  study  revealed  a  reduetion  at  the  intervention  hospital  in  the  number  of  x- 
rays,  time  of  treatment  and  total  eosts  assoeiated  with  treatment.  Patient  satisfaetion  with 
serviees  did  not  ehange  signifieantly.  Ottawa  Ankle  Rule  sensitivities  were  1.0  (reported 
as  95%eonfidenee  interval-  or  .95  to  1)  for  malleolar  fraetures  (74  total),  and  1.0  for 
deteeting  19  midfoot  fraetures.  Conelusions  of  this  large  study  suggest  implementation 
of  the  OAR  led  to  deerease  in  radiography,  waiting  times,  and  eosts  without  patient 
dissatisfaetion  or  missed  fraetures.  The  OAR  have  subsequently  been  tested  and  found  to 
be  highly  sensitive  and  reliable  measures  of  the  likelihood  of  signifieant  fraeture.  The 
OAR  are  better  at  predieting  the  need  for  x-ray  than  elinical  suspieion  alone,  in  cases  of 
BAT  in  non-pregnant  adults  (Lueehesi,  Jaekson,  Peaeoek,  Cerasani,  &  Swor,  1995;  Stiell 
et  ah,  1993)  (see  Table  2,  Studies  Using  the  Ottawa  Ankle  Rules  to  Prediet  Fraeture). 
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Table  2 


Studies  Using  the  Ottawa  Ankle  Rules  to  Predict  Fracture 


Author(s)  #  of  Cases 

Sensitivity 

Specificity 

Ankle  Both  Foot 

Ankle  Both  Foot 

Pigman  et  al.  (1994)-USA  110 

*  OAR  reduced  x-rays  19% 

1.0 

0.19 

Lucchesi  et  al.  (1995)-USA  484 

0.946  0.931 

0.155  0.115 

Auleley  et  al.  (1997)-France  4,980 

*OAR  reduced  x-rays  22.4% 

McBride  (1997)-Canada  296 

*OAR  could  reduce  x-rays  by  26.3% 

0.971 

0.302 

Verma  et  al.  (1997)-USA  926 

*OAR  reduced  x-rays  by  16% 

0.99 

0.22 

Salt  et  al.  (1997)-England  324 

-  238  (73%)  received  nurse-requested  x-ray:  20%  had  fractures. 

-  Of  the  remaining  86,  19  had  x-rays  (per  MD)  and  no  fracture  was  detected. 

-  67  with  no  x-ray  ordered  returned  in  the  subsequent  eight  weeks. 

-  Concluded  nurses  can  apply  OAR  safely  without  missing  acute  fractures 

Clinical  Practice  Guidelines 

Guidelines  are  popular.  The  definition  of  guideline  has  been  expanded  to  mean 
many  kinds  of  guidance.  The  definition  should  be  narrowed  to  include  only  rules  about 
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when  to  initiate  and/or  when  to  avoid  medieal  interventions  (tests,  treatments,  and  other 
aetions)  that  are  valid  and  deeidable  within  speeified  medieal  eontexts  (MeDonald  & 
Overhage,  1994).  By  this  definition,  predietion  rules  designed  to  deeide  when  to 
intervene  are  guidelines.  Researeh-based  rules  are  essential  in  the  development  of 
olinieal  guidelines  (Duff,  Kitson,  Seers,  &  Humphris,  1996).  Clinieal  guidelines  are 
serving  an  inereasingly  important  role  within  evolving  health  eare  systems  and  it  s  been 
suggested  guidelines  serve  as  edueational  tools  (James,  Cowan,  Graham,  &  Majeroni, 
1997).  Though  providers  may  fear  the  intrusion  of  praetiee  guidelines,  the  major  impetus 
for  development  of  guidelines  is  to  improve  the  quality  of  eare  provided  to  patients 
(Greeo  &  Eisenberg,  1993;  James  et  ah,  1997;  Weingarten,  1976). 

A  growing  number  of  ageneies  (the  USAF  health  serviee  ineluded)  are  developing 
olinieal  praetiee  guidelines  that  outline  the  proper  eare  of  medieal  oonditions  (Epstein, 
1990;  Woolf,  1992).  It  is  diffioult  for  praetiee  guidelines  to  define  optimal  eare  (Woolf, 
1995),  however  the  OAR  are  based  on  empirioal  researoh,  do  not  use  rigid  language  to 
desoribe  right  or  wrong  treatment  and  reoognize  the  individual  and  the  need  for  a 
thorough  history  and  physioal  assessment  in  eaoh  ease  of  BAT. 

In  outoomes  management  there  are  oritioal  faotors  involved  (Epstein,  1990).  Use  of 
the  OAR  and  elinieal  praetiee  guidelines  in  general  supports  the  fiseally  eompetitive 
nature  of  a  ehanging  health  eare  market.  A  eapitated  market  eneourages  eost 
eonsiderations  and  aeknowledgment  of  patient  satisfaetion  as  an  outeome  measure  (or 
patients  will  go  elsewhere  for  eare).  Costs  deerease  with  a  reduetion  in  x-ray  use  in  eases 
of  BAT.  Use  of  the  OAR  ensures  the  best  patient  praetiees  are  done  at  the  right  time. 
Sinee  1970,  health  maintenanee  organizations  have  grown  20-fold,  renewing  the  sense  of 
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competition  in  health  eare.  TRICARE,  as  a  managed  care  option  plan,  has  introdueed 
eompetition  into  the  military  medieine  environment.  Rules  and  guidelines  that  promote 
effieient,  safe,  and  effeetive  use  of  resourees  ean  improve  patient  outcomes. 

Summary 

Sinee  antiquity,  there  has  been  medieal  interest  in  how  best  to  treat  ankle  injuries.  The 
OAR  are  predietion  rules  that  deeide  when  to  intervene,  and  as  sueh  are  guidelines 
assisting  the  provider  in  making  the  deeision  whether  or  not  to  x-ray.  The  ankle  joint  and 
feet  are  eomplex  struetures  serving  important  funetions.  The  development,  testing  and 
validation  of  the  OAR  has  demonstrated  the  rules  to  have  a  part  of  the  thorough  physieal 
exam  of  the  patient  who  has  reeently  experieneed  BAT.  More  than  one  authority  has 
suggested  x-rays  are  not  neeessary  for  most  ankle  injuries.  The  OAR  are  valid,  reliable 
measures  of  the  need  to  get  an  ankle  x-ray.  The  use  of  the  Ottawa  Ankle  rules  in  the 
setting  of  United  States  Air  Foree  medical  care  is  unknown.  The  use  of  the  OAR  eould 
prove  of  benefit  to  the  Air  Force  Medical  Service  as  it  initiates  TRICARE  by  deereasing: 
(a)  time  spent  in  treatment,  (b)  number  of  x-rays,  and  (c)  eosts  in  treating  BAT. 
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CHAPTER  THREE;  METHODS 


The  purpose  of  this  study  was  to  determine  if  the  Ottawa  Ankle  Rules  (OAR)  and/or 
other  clinieal  information,  tests  or  rules  are  being  utilized  by  aetive-duty  United  States 
Air  Force  (USAF)  nurse  practitioners  (NPs)  and  physician  assistants  (PAs)  to  determine 
fracture  in  cases  of  blunt  ankle  trauma  (BAT).  This  chapter  describes  the  methodology 
of  the  study:  the  research  design,  sample,  measurement,  protection  of  human  rights,  and 
describes  the  plan  for  data  analysis. 

The  following  research  questions  were  addressed:  (a)  Are  the  Ottawa  Ankle  Rules 
clinical  guidelines  being  used  by  a  sample  of  active-duty  USAF  NPs  and  PAs?  (b)  Is 
there  a  difference  in  the  selective  use  of  x-rays  in  case  scenarios  between  NPs  and  PAs? 
(c)  Is  there  a  theoretical  financial  benefit  to  using  the  Ottawa  Ankle  Rules?  (d)  What 
clinical  information,  tests,  or  rules  are  used  to  determine  if  fracture  is  present  in  blunt 
ankle  trauma? 

Research  Design  and  Procedures 

This  study  was  essentially  descriptive  in  design.  It  consisted  of  a  mailed 
questionnaire  (Appendix  A)  that  gathered  demographic  data  and  described  the 
participant  s  practice  setting,  and  clinical  experience.  On  4  October,  1998  following  the 
Uniformed  Services  University  of  the  Health  Sciences  Institutional  Review  Board 
approval  and  receipt  of  a  USAF  control  number,  an  initial  mailing  of  adequate  size  was 
mailed  to  the  individual  address  of  each  participant  selected  by  roster.  The  mailer 
included  an  explanatory  consent  letter  (Appendix  H),  a  copy  of  the  instrument,  and  a  self- 
addressed,  postage-paid  envelope  (4  1/8  x  9  _  inches-  all  purpose,  white  for  office  use) 
for  return.  Forty-five  days  was  allowed  for  an  adequate  response  period.  A  follow-up 
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postcard  to  the  same  addressees  were  mailed  to  ensure  adequate  return  rates.  A  second 
mailing  was  not  necessary.  One  respondent  telephoned  requesting  a  duplicate 
questionnaire.  The  returns  were  addressed  to  the  researcher  s  university  mailbox  to 
minimize  handling  error. 

Sample 

Participants  were  selected  from  a  mailing  list,  obtained  from  the  USAF  personnel 
offiee,  using  a  random  selection  process.  A  single,  inclusive  list  of  CONUS-assigned, 
USAF  NPs  and  PAs  was  utilized.  All  eligible  NPs  were  selected  (Primary,  Adult,  and 
Family  Air  Force  Speeialty  Codes  [AFSCs]).  A  seeond  PA  mailing  list  was  randomly 
drawn  to  equal  size  to  the  NP  mail  list.  Only  General  duty  PAs  were  considered. 
Members  within  eaeh  group  had  equal  opportunity  at  selection. 

By  a  September  1997  report  there  were  31  NPs  with  AFSCs  appropriate  for 
consideration  in  this  study  (Maj.  S.  Hall,  personal  communieation,  20  April,  1998).  This 
number  does  not  include  pediatric  nurse  practitioners,  women  s  health  nurse 
praetitioners,  midwives  or  nurse  anesthetists.  The  eriteria  for  PAs  ineluded  active  duty 
PAs  (biomedical  clinician)  currently  assigned  against  USAF  specialty  codes  described  as 
general  physician  assistant.  Initial  numbers  of  total  PAs  as  of  15  April,  1998  was  427  (S. 
Hall,  personal  communication,  14  April  1998).  For  USAF  security  reasons,  the 
investigator  was  unable  to  differentiate  PAs  by  specialty  work  areas.  Hence  the 
population  list  included  PAs  in  the  specialties  of  otolaryngology,  perfusion,  and 
orthopedics.  These  PA  speeialties  were  excluded. 

When  planning  a  study  one  determines  the  desired  power,  acceptable  significance 
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level,  and  expeeted  effeet  size  and  uses  these  three  parameters  to  determine  the  neeessary 
sample  size  (Munro  &  Page,  1993).  The  sample  size  from  eaeh  group  was  28  for  a  total 
mailing  of  58.  An  antieipated  return  rate  of  50%  would  yield  a  sample  size  of 
approximately  28.  A  sample  size  of  27  is  needed  for  an  alpha  level  of  .05  (two-tail)  with 
effeet  size  of  medium  to  large  (E.  Levine,  personal  eommunieation,  14  April,  1998).  The 
reeeipt  of  29  respondents  was  a  sample  large  enough  to  be  representative,  but  small 
enough  to  eontain  eosts. 

Measurement 

A  researeher-developed  instrument  was  used  in  this  study  (Appendix  A).  Permission 
was  obtained  (Appendix  G),  and  eomponents  of  the  OAR  were  used  for  the  written  ease 
seenarios  that  beeame  part  of  the  instrument.  Following  a  portion  for  demographie  data, 
partieipants  were  asked  to  seleet  YES  or  NO  to  Is  an  ankle  x-ray  required?  for  eaeh  of  1 1 
ease  seenarios.  Case  studies  were  unidireetional  (positive  or  negative)  and  have  one 
eorreet  response  (in  six  eases  YES,  and  five  eases  NO).  Cases  were  mixed  but  not 
randomized  on  the  questionnaire.  Data  retrieved  from  the  returned  instruments  were 
grouped,  analyzed,  and  presented  using  statistieal  software  available  to  the  investigator. 

The  instrument  underwent  review  by  a  panel  of  two  individuals  reeognized  as 
experts  in  the  area  of  eoneern.  Both  were  medieal  physieians  and  held  speeialty 
eertifieations  in  emergeney  medieine.  Eaeh  had  experienee  using  the  OAR  for  at  least 
the  last  3  years.  Both  had  been  in  praetiee  at  least  5  years,  and  had  extensive  experienee 
treating  ankle  injuries  in  the  primary  eare  or  emergent  setting.  Both  were  appropriately- 
lieensed  providers  aeeording  to  federal,  provinee  or  state  regulations.  A  review  form  was 
provided  to  eaeh  evaluator.  This  review  form  ineluded  a  Likert-type  seale  for  eaeh  expert 
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to  rate  the  ease  seenarios.  Eaeh  reviewer  was  also  asked  to  eomment  on  the  readability  of 
the  instrument.  The  sealed  items  will  be  numerated  and  averaged  on  a  1-4  seale  (1-not 
related,  2-slightly  unrelated,  3 -slightly  related,  and  4-very  related)  for  applieability  to  the 
OAR. 

Validity  pertains  to  the  extent  to  whieh  the  tool  aetually  refleets  the  problem  being 
measured.  Content  validity  of  the  ereated  instrument  was  aeeomplished  through  use  of 
the  expert  panel  as  noted  above.  Members  were  seleeted  based  on  eriteria  and  referral.  A 
numerie  value,  refleeting  the  level  of  eontent-related  validity,  was  measured  using  a 
eontent  validity  index  deseribed  by  Waltz  and  Bausell  (as  eited  in  Burns  &  Grove,  1997). 
This  study  goal  was  a  eontent  validity  of  >  0.80.  The  instrument  yielded  a  eontent 
validity  index  of  0.93,  providing  supporting  evidenee  for  the  validity  of  the  tool.  As 
mentioned,  the  experts  eommented  on  readability  of  the  instrument,  an  essential  element 
of  the  validity  and  reliability  of  the  instrument. 

Proteetion  of  Human  Subjeets 

Partieipation  in  this  study  was  eompletely  voluntary.  A  eover  letter  was  ineluded 
with  the  instrument  that  explained  the  purpose  of  the  study  and  that  eompletion  of  the 
survey  implied  informed  eonsent.  The  study  reeeived  approval  from  the  thesis  eommittee 
and  the  Institutional  Review  Board  at  the  USUHS  (Appendix  C).  A  survey  eontrol 
number  was  obtained  from  the  pertinent  USAF  offiee  (Appendix  D).  To  ensure 
eonfidentiality,  the  returned  questionnaires  did  not  eontain  identifying  information.  The 
investigator  had  sole  roster  eustody.  Partieipants  withdraw  from  the  study  by  not 
returning  the  questionnaire.  Partieipation  involved  no  apparent  risk  to  a  patient 
population  or  the  respondents.  There  were  no  direet  benefits  to  partieipants,  who  donated 
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time  to  participate.  Indirect  benefits  may  be  obtained  in  consideration  of  the  potential 
educational  benefit  of  the  study.  Returned,  completed  questionnaires  were  secured.  The 
investigator  had  sole  access  to  the  completed  questionnaires. 

Plan  for  Data  Analysis 

Variables  were  coded  (Appendix  B)  for  computerized  data  entry  and  analysis.  The 
Statistical  Packages  for  the  Social  Sciences  (SPSS)  Graduate  Pack  8.0  for  Windows 
(1997)  computer  program,  was  used  in  part  to  generate  statistics  that  summarized 
quantities  of  descriptive  data  into  meaningful  frequency  distributions,  measuring 
variability,  and  interpreting  raw  data  of  yes  or  no  responses  into  percentages.  The  ability 
to  accurately  select  whether  or  not  to  order  an  x-ray  is  required  in  case  scenarios  of  BAT 
between  NPs  and  PAs  was  compared.  Descriptive  and  demographic  data  concerning  the 
sample  were  presented  in  cross  tab  format.  A  theoretical  cost  benefit  is  represented  using 
a  formula  based  on  x-rays  inaccurately  ordered:  Total  of  inaccurately-ordered  x-rays  for 
all  respondents,  multiplied  by  the  average  dollar  cost  of  a  single  x-ray. 

Summary 

This  descriptive  study  was  designed  to  gain  more  information  about  NPs,  PAs  and 
their  use/knowledge  of  the  OAR.  The  instrument  used  was  investigator-developed, 
descriptive,  and  contained  1 1  written  BAT  scenarios  based  on  assessment  criteria 
contained  within  the  OAR.  The  tool  was  validated  for  content,  including  review  by  a 
panel  of  two  experts.  The  selected  sample  was  randomized  to  permit  adequate 
representation  of  specialties  in  the  fields  of  nurse  practitioner  and  physician  assistant. 
Human  subjects  were  protected  through  the  use  of  anonymous  responses. 
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CHAPTER  FOUR:  ANALYSIS  OF  DATA 


Introduction 

The  purpose  of  this  study  was  to  determine  if  the  Ottawa  Ankle  Rules  (OAR),  or 
other  elinieal  information,  tests  or  rules  are  being  utilized  by  aetive-duty  United  States 
Air  Foree  (USAF)  nurse  praetitioners  (NPs)  and  physieian  assistants  (PAs)  to  determine 
fraeture  in  eases  of  blunt  ankle  trauma  (BAT).  This  ehapter  deseribes  the  sample, 
ineluding  size,  and  presents  the  data  obtained  by  the  researeh  questionnaire  ineluding 
responses  to  1 1  ease  seenarios  by  study  partieipants. 

This  study  eonsisted  of  a  deseriptive  design,  eomparing  NP  and  PA  use  of  the  Ottawa 
Ankle  Rules  to  evaluate  a  eommon  elinieal  phenomena.  The  questionnaire  (Appendix  A) 
was  developed  by  the  author  to  identify  faetors  having  a  potential  impaet  on  the 
phenomena  of  BAT.  The  study  sample  eonsisted  of  two  groups  of  providers,  NPs  and 
PAs. 

Sample 

Following  Uniformed  Serviees  University  review  and  Air  Foree  questionnaire 
approval  (Appendix  C  and  D),  56  questionnaires  were  mailed  on  4  Oetober  1998  to  a 
sample  drawn  from  a  roster  of  NPs  and  PAs  with  stateside  assignments.  A  total  of  28 
primary  eare/adult/family  NPs  were  on  this  roster  as  of  1  August  1998.  In  addition,  28 
physieian  assistants  were  randomly  seleeted  from  a  total  PA  population  of  220  using  a  list 
of  random  numbers  (Bums  &  Grove,  1997). 

The  sample  was  seleeted  from  a  list  obtained  through  The  Freedom  of  Information 
Aet  from  Headquarters,  Air  Foree  Personnel  Center/MSIMD,  Randolph  Air  Foree  Base, 
Texas.  Seeurity  issues  preeluded  a  worldwide  USAF  sampling  opportunity  (See 
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Appendix  E).  Participants  receiving  a  questionnaire  mailing  were  located  in  1 1  of  the  12 
TRICARE  service  regions.  Region  1 1  (Washington,  Oregon)  was  not  represented,  as  no 
respondent  from  that  region  was  selected  due  to  the  random  sample.  Since  respondents 
were  not  identified  it  could  not  be  determined  if  those  returning  the  questionnaires  had 
differing  characteristics  from  nonrespondents.  A  follow-up  letter  was  mailed  19  October 
1998  (Appendix  F).  As  a  result,  one  NP  telephoned  the  investigator  to  request  a  copy  of 
the  questionnaire  due  to  loss  of  the  original  questionnaire. 

A  57%  response  rate  was  obtained  with  the  return  of  32  completed  questionnaires. 
Data  were  useable  from  29  questionnaires:  18  NPs  and  1 1  PAs.  One  questionnaire  was 
not  used  due  to  provider  status  (civilian  NP),  and  one  was  undeliverable  (NP).  A  third 
questionnaire  was  not  used  because  the  respondent  was  no  longer  in  the  Air  Force  (PA). 
Data  were  summarized  for  all  the  variables  on  the  questionnaire.  They  are  discussed  in 
the  following  sections  of  the  chapter. 

Demographics 

Table  3  summarizes  the  demographic  data  obtained  from  29  respondents.  The  total 
months  of  job  experience  for  both  provider  types  had  a  range  from  three  months  to  over 
21  years  with  a  mean  of  53  months.  All  NPs  and  10  of  the  1 1  PAs  were  prepared  at  the 
master  s  degree  level,  one  PA  reporting  a  baccalaureate  level  of  education.  No 
respondents  held  doctorate  degrees. 

A  majority  (86%)  of  respondents  worked  in  primary/acute  care,  or  family  medicine. 
One  PA  was  an  orthopedic  fellow  and  worked  in  an  orthopedic  clinic.  One  PA  and  one 
FNP  reported  working  in  both  an  emergency  department  and  primary/family  clinic.  A 
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Table  3 


Characteristics  of  Nurse  Practitioner  and  Physician  Assistant  Respondents 


Characteristic  Nurse  Practitioners  (N=18) 

Physician  Assistant  (N=l  1) 

Family  nurse  practitioners 

15 

General  physician  assistants  10 

Primary  or  Adult  NPs 

3 

Orthopedic  Fellow/P  A  1 

Months  as  a  Provider 

Mean  37.7 

80.6 

Median 

15 

7 

Range  3-253 

36-156 

Highest  Education  Level 

Masters  degree 

18 

10 

Practice  Setting 

Emergency  Department 

1 

1 

Primary  Care/Family  Health 

16 

9 

Orthopedic  clinic 

0 

1 

Aerospace  Medicine  /  Primary  Care 

1 

0 

Assigned  Mobility  Position  (see  text) 

Yes 

11 

5 

No 

7 

6 

Mean  number  of  ankle  evaluations/  month 

6.3 

13.2 

Note:  N  =  Number  of  respondents. 


FNP  reported  working  in  aerospace  medicine  and  a  primary  care  clinic.  One  respondent 
(NP)  did  not  have  x-ray  capability  at  the  clinical  site. 
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Respondents  had  the  opportunity  for  multiple  responses  in  deseribing  military 
readiness  and  mobility  aetivities.  Data  were  derived  from  two  statements  on  the  BAT 
questionnaire  (See  Appendix  A).  The  two  statements  were  (a)  Are  you  assigned  a 
mobility  position  ,  and  (b)  Past  deployments  (eheek  all  that  apply)  .  Fifty-five  pereent 
(55%)  of  respondents  were  in  job  positions  that  included  assignment  to  a  mobility 
position,  part  of  a  personnel  group  deployable  on  receipt  of  orders.  Respondents 
experiences  included  exercises  and/or  actual  deployments.  Nearly  14%  of  respondents 
reported  participation  in  both  exercises  and  actual  deployments.  Over  half  of  respondents 
reported  participation  in  military  missions,  mainly  exercises  (Table  4). 

Adherence  to  Ottawa  Ankle  Rules 

The  OAR  are  validated  clinical  decision  rules  developed  to  assist  health  care 
providers  in  their  use  of  plain  x-rays  when  evaluating  BAT.  This  study  posed  four 
research  questions  relating  to  the  use  of  the  OAR.  Data  regarding  two  research  questions 
are  presented  in  Table  5:  (a)  Are  the  OAR  clinical  guidelines  being  used  by  a  sample  of 
USAF  nurse  practitioners  and  physician  assistants?  and  (b)  What  clinical 
information,  tests,  or  rules  are  used  to  determine  if  fracture  is  present  in  written  cases  of 
blunt  ankle  trauma?  Participants  also  responded  to  the  open-ended  item  on  the 
questionnaire  (See  Appendix  A):  What  clinical  information  and/or  tests  do  you  utilize 
to  determine  if  an  x-ray  is  required  in  cases  of  blunt  ankle  trauma? 

Responses  were  grouped  by  physical  exam,  history,  and  other  categories,  and 
ranked  by  frequency.  Only  10%  of  respondents  reported  use  of  the  OAR  in  evaluating 
blunt  ankle  trauma.  Three  physical  exam  items:  The  ability  to  bear  weight/ambulate 
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immediately  and  in  the  emergency  department,  point  tenderness  in  specific  locations  on 
the  ankle  and  foot,  and  discomfort/pain  combined,  composed  41%  of  the  responses  in 
that  category.  In  the  history  category,  mechanism  of  injury  was  cited  21  times  ;  56%  of 
Table  4 

Participation  in  Military  Missions  by  Respondents 

Military  Mission  Respondents  Participating 

_ Number* _ Percent  of  Total  Responses 


Exercises 


14 
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Restore  Hope 
Just  Cause 
Gulf  War 
Albania/Niger 
None 


1 

1 

3 

1 

13 


3 

3 

10 

3 

45 


Note:  Includes  several  respondents  who  participated  in  more  than  one  mission. 
None  of  the  respondents  were  deployed  in  support  of  the  Vietnam  War  or  troops 
currently  in  Bosnia. 


the  total  responses  in  this  category. 

Age  was  reported  as  a  factor  in  the  decision  to  x-ray,  particularly  when  the  patient 
was  less  than  25  years  old.  The  five  most  frequently  mentioned  items  reported  as 
important  to  respondents  included  both  physical  exam  and  history  items  (Table  6).  Point 
tenderness  was  the  provocative  test  mentioned  most  often.  Other  provocative  tests 
included  (anterior)  drawer  test,  stability  (varus/valgus/talar  tilt)  tests,  squeeze  test,  and/or 
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Table  5 


Clinical  Information  or  Tests  Utilized  to  Determine  if  X-ray  is  Required  in  Blunt  Ankle 
Trauma  Cases 


PHYSICAL  EXAM 

HISTORY 

Number  of  Times  Mentioned 

Number  of  Times  Mentioned 

*Bear  Weight/ambulate 

19 

Mechanism  of  injury 

21 

Edema/Swelling 

17 

General  previous  history- 
(trauma,  surgery/hardware) 

12 

*Pomt  tenderness 

16 

What  s  worked  so  far 

2 

Redness/ecchymosis/hematoma 

9 

Prompt  return  to  activity 

1 

(Anterior)  Drawer  test 

6 

Type  of  footwear  at  time  of 
injury  (shoes  versus  boots) 

1 

*Discomfort/pam 

6 

Total 

37 

Range  of  motion 

6 

OTHER 

Circulatory  (vascular/sensation) 

6 

Age 

3 

Stability  (varus/valgus/talar  tilt) 

5 

Gut  feeling 

2 

Ottawa  Ankle  Rules 

3 

Unusual  presentation 

1 

Obvious  deformity,  or  exam 

each  with 

3 

Total 

6 

Squeeze  test,  or  pop 

each  with 

2 

Strength,  crack  ,  or  +  grind 

each  with 

1 

Total 

99 

Note:  *Ottawa  Ankle  Rules  criteria  from  I.  Stiell,  D.  McKnight,  et  al.  1994,  p.  828. 
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grind  test.  Of  the  24  different  items  mentioned  as  important  in  determining  whether  or 
not  to  x-ray,  the  history  items,  meehanism  of  injury,  and  previous  trauma,  eomposed  89% 
of  all  history  eategory  responses  and  23%  of  total  responses. 

Researeh  question  three  asked:  Is  there  a  differenee  in  the  seleetive  use  of  x-rays  in 
case  scenarios  between  NPs  and  PAs?  Respondents  were  asked  to  indicate  whether  or 
not  an  x-ray  is  required  for  each  of  1 1  case  scenarios  by  selecting  Yes  or  No  .  Each 
case  was  constructed  for  a  most  accurate  response,  in  an  attempt  to  avoid  selection 

Table  6 


Most-Frequently  Mentioned  Items  as  Important  to  Nurse  Practitioner  and  Physician 
Assistant  Respondents 


Item  Number  of  Times  Mentioned 

Percent  of  Times  Mentioned 

Mechanism  of  injury' 

21 

15 

Ability  to  bear  weight/ambulate^ 

19 

13 

Edema/swelling^ 

17 

12 

*Point  tenderness^ 

16 

11 

Previous  trauma,  surgery. 

or  retained  hardware' 

12 

8 

Note.  *  Provocative  test.  ^  History  category.  ^  Physical  Exam  category 


bias.  The  most  accurate  selection  was  Yes  for  cases  1,  3,  5,  7,  9,  and  10.  No  was  the 
most  accurate  selection  for  cases  2,  4,  6,  8,  and  11.  Table  7  shows  a  difference  in 
accuracy  between  NPs  and  PAs  of  only  1%. 
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Accuracy  for  specific  scenarios  were  similar  for  NPs  and  PAs  (see  Table  8). 
Seenario  seven  had  100%  aeeuraey  for  both  groups.  Both  groups  had  the  least  aeeuraey 
in  ease  4;  only  56%  for  NPs,  and  45%  for  PAs.  NPs  had  greater  aeeuraey  than  PAs  in 
Table  7 


Nurse  Praetitioners  and  Physieian  Assistants  Aeeuraey:  Frequeney  of  Case  Responses 


Number  of  Responses 

Provider  Type 

Most  Aeeurate 

Least  Aeeurate 

%  Aeeurate 

Nurse  Praetitioners 

169 

29 

83 

Physieian  Assistants 

103 

16 

84 

eases  4,  8,  9,  and  10.  PAs  had  greater  aeeuraey  in  cases  1,  2,  3,  5,  6,  and  11.  NPs  were 
100%  aecurate  in  ease  7.  PAs  were  100%  aeeurate  in  eases  1,  3,  5,  6,  and  7.  When 
eomparing  aeeuraey,  the  two  groups  NPs  and  PAs,  appear  elustered.  Cases  1,  2,  5,  7,  8, 

9,  10,  and  1 1  were  equal  in  aeeuraey  to  6%  or  less  difference  between  groups.  Cases  3, 

4,  and  6  differenees  between  the  NPs  and  PAs  ranged  from  1 1  to  17%  aeouraey. 

Seenario  responses  from  both  groups  were  eombined  to  determine  overall  respondent 
aeeuraey  (See  Table  9). 

The  fourth  researeh  question  asks:  Is  there  a  theoretieal  finaneial  benefit  to  using  the 
Ottawa  Ankle  Rules?  Respondents  inaceurately  indicated  they  would  obtain  x-rays  in  36 
of  the  possible  145  times  it  would  have  been  most  aeeurate  not  to  obtain  an  x-ray.  A  total 
of  36  unneeessary  x-ray  procedures  would  be  quite  eostly.  The  eost  of  a  single  x-ray, 
based  on  dollar-value  obtained  from  one  USAF  medieal  eenter  located  in  TRICARE 
Region  One,  Northeast  is  $35.92,  ineluding  interpretation  costs  (B.  Cunningham, 
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TRICARE  /MEPRS,  personal  communication,  22  December,  1998).  When  36 
unnecessary  x-rays  are  multiplied  by  the  per  unit  cost,  this  total  is  $1,293.  Often,  more 


Table  8 

Percent  Accuracy  in  1 1  Blunt  Ankle  Case  Scenarios  by  Provider 


Scenario  Number 

Nurse  Practitioners 

Provider 

Phvsician  Assistants 

1 

95 

100 

2 

89 

91 

3 

83 

100 

4 

56 

45 

5 

94 

100 

6 

89 

100 

7 

100 

100 

8 

83 

82 

9 

95 

90 

10 

95 

90 

11 

61 

64 

than  one  x-ray  view  will  be  required.  Pfeffer  (1998)  reports  AP  [anterior-posterior], 
lateral,  and  oblique  (slightly  internally  rotated  AP)  radiographs  will  show  most 
fractures  Minimally  displaced  fractures  may  not  appear  on  initial  radiographs; 
therefore,  radiographs  should  be  repeated  in  10-14  days,  if  there  is  a  high  suspicion  of  a 
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fracture  (p.  425).  If  the  total  unneeessary  cost  is  multiplied  by  three  (the  average 
number  of  initial  x-rays  per  BAT  episode),  the  cost  becomes  $3,879,  a  significant  amount 
indeed. 


Table  9 

Nurse  Practitioners  and  Physieian  Assistants  Combined  Accuraey  by  Blunt  Ankle 
Trauma  Case  Seenario 


Scenario  Number 

Number  of  Respondents 

Percentage 

Aceurate  to  order  an  x-ray 

1 

28 

97 

3 

26 

90 

5 

28 

97 

7 

29 

100 

9 

26 

93 

10 

26 

93 

Accurate  to  not  order  an  x-ray 

2 

25 

86 

4 

15 

52 

6 

27 

93 

8 

24 

83 

11 

18 

62 
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Verbeek  and  colleagues  (1994)  retrospeetively  reviewed  123  sets  of  emergeney 
department  ankle  x-rays  to  determine  if  three  views  were  needed.  They  eoneluded  The 
mortise  and  lateral  views  are  suffieient  for  diagnosing  ankle  fraetures  instead  of  the 
standard  AP,  lateral,  and  mortise  views.  .  .  .  and  imply  a  substantial  deerease  in  radiation 
and  eost  savings  to  the  patient  (p.  172).  Thirty-six  unneeessary  x-rays  tests,  multiplied 
by  two  (2  views),  then  by  $35.92  yields  a  theoretieal  benefit  of  $2,586  for  initial 
diagnostie  x-rays  only. 

Summary 

The  purpose  of  this  study  was  to  determine  if  the  Ottawa  Ankle  Rules  or  other 
elinieal  information,  tests  or  rules  are  being  utilized  by  aetive-duty  USAF  nurse 
praetitioners  and  physieian  assistants  to  determine  fraeture  in  eases  of  blunt  ankle  trauma. 
This  ehapter  presented  a  diseussion  of  eharaeteristies  of  respondents,  and  data  on  the  four 
researeh  questions. 

The  variables  ineluded  in  the  questionnaire  elieited  data  pertaining  to  the  Air  Foree 
NPs  and  PAs  eharaeteristies,  elinieal  praetiee  setting,  and  elinieal  information/tests 
utilized  to  determine  if  an  x-ray  test  is  required  in  eases  of  BAT.  The  elinieal  BAT 
seenarios  evaluated  the  respondent  s  aeeuraey  in  determining  if  an  x-ray  was  required. 
Costs  of  unneeessary  x-rays  were  estimated.  Aeeuraey  of  NP  and  PA  respondents  was 
shown  for  the  1 1  test  seenarios  used  in  the  study. 

Chapter  five  will  provide  a  further  diseussion  of  the  study  data  and  make 
reeommendations  for  further  researeh.  Implications  for  military  medical  readiness, 
edueation,  and  fiseal  resourees  will  also  be  diseussed. 
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CHAPTER  FIVE;  SUMMARY,  CONCLUSIONS  AND  RECOMMENDATIONS 

Introduction 

The  ankle  is  the  most  frequently  injured  joint  in  the  body  and,  as  sueh,  ankle  trauma 
is  a  eommon  presentation  in  North  Ameriean  emergeney  departments  (EDs).  Weinstein 
(1993)  estimates  that  1  million  people  present  to  EDs  and  aeute  care  elinies  eaeh  year 
with  blunt  ankle  trauma  (BAT),  with  95%  reeeiving  an  x-ray.  Of  the  over  6  million 
radiographie  series  performed  eaeh  year  for  ankle  trauma,  only  14  to  20%  will 
demonstrate  a  fraeture  (Clark  et  ah,  1995;  Stiell,  1994;  Stiell,  Greenberg,  et  ah,  1992; 
Stiell,  MeDowell  et  ah,  1992;  Verma  et  ah,  1997),  and  represents  a  eost  to  the  United 
States  and  Canada  of  _  billion  dollars  ($500,000,000)  (Stiell,  1996). 

The  purpose  of  this  study  was  to  determine  if  the  Ottawa  Ankle  Rules  (OAR),  or 
other  elinieal  information,  tests  or  rules  are  being  utilized  by  aetive-duty.  Air  Foree  nurse 
praetitioners  (NPs)  and  physieian  assistants  (PAs)  to  determine  if  x-ray  is  required  in 
eases  of  BAT.  Methodology  eonsisted  of  developing  a  tool  that  ineluded  demographie 
variables  and  case  seenarios  developed  using  the  OAR  criteria.  A  panel  of  two  eontent 
experts  reviewed  the  questionnaire  for  eontent  validity  to  minimize  systematie  error 
(Appendix  A).  Speeifie  instruetions  for  evaluating  eaeh  item  and  the  total  instrument 
were  given  to  the  experts.  The  instrument  yielded  a  eontent  validity  index  of  0.93, 
providing  supporting  evidenee  for  the  validity  of  the  tool.  No  pilot  study  was  condueted. 
Data  were  obtained  from  29  of  32  returned  questionnaires,  a  return  rate  of  57%. 

Conelusions 

Sample 

The  entire  population  of  United  States-assigned  (CONUS)  NPs  (adult,  family. 
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primary  care)  were  seleeted  to  represent  those  who  were  likely  to  see  non-pregnant,  adult, 
primary  eare  patients.  The  PA  sample  was  randomly  seleeted  in  order  to  a  seleet  a 
representative  group  equal  in  size  to  that  of  the  NP  sample.  The  questionnaires  were 
mailed  to  100%  of  CONUS  adult,  family  and  primary  eare  NPs  in  partieular  Air  Foree 
speeialty  eodes  (AFSCs-  46N1H,  46N3H,  46N1C,  &  46N3C)  and  to  28  of  the  total  220 
PAs  not  working  in  the  orthopedie,  otolaryngology  or  perfusionist  speeialties  {AFSCs- 
42G1,  &  42G3)  on  the  CONUS  list.  With  this  sample  seleetion  method,  it  eould  be  said 
that  members  of  eaeh  of  these  groups  did  not  have  an  equal  opportunity  for  seleetion  in 
the  study.  The  return  rate  of  nearly  60%  eompares  favorably  to  return  rates  obtained  by 
mailed  questionnaires. 

In  the  past  five  years,  the  USAF  medical  service  has  inereased  the  utilization  of 
family  NPs  (FNPs).  Their  numbers  were  well  represented  in  the  NP  sample:  15  of  the  18 
NPs  were  FNPs.  The  NP  return  rate  was  64%.  The  PA  group  return  rate  was  39%.  The 
follow-up  mailing  was  an  eeonomieal  method  to  boost  the  rates  of  questionnaire  return. 
The  aetual  impaet  of  the  follow-up  mail  reminder  was  not  assessed.  The  USAF  point  of 
eontaet  ensured  the  alpha  roster  was  eurrent  within  one  ealendar  quarter  and  inelusive  for 
the  study  eriteria,  a  strength  of  the  study.  Due  to  the  overall  low  return  rate, 
generalizability  of  the  findings  is  limited. 

Nurse  Praetitioners  and  physieian  assistants  reported  similar  deployment  rates, 
assignment  against  mobility  slots,  and  exereise  rates.  In  this  regard,  respondent  duties 
appear  to  have  elinieal  and  edueational  similarities  despite  being  in  different  provider 
eategories.  Both  groups  of  respondents  worked  in  primary  eare  settings,  had  an  average 
of  over  two  years  experienee  and  were  prepared  through  graduate  edueation.  Use  of  the 
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OAR  by  both  groups  could  improve  the  effeetive  use  of  x-rays  from  the  75%  speeifieity 
noted  in  this  study  to  the  near  100%  eited  in  the  literature. 

Demographics 

A  majority  (86%)  of  the  well-edueated  respondents  worked  in  primary/aeute  eare,  or 
family  medicine  areas.  One  respondent  indicated  an  inability  to  aeeess  x-ray  teehnology 
on  site.  X-ray  teehnology  is  eommonplace  in  most  CONUS  practiee  settings.  Only  the 
most  austere  of  praetiee  environments  would  not  provide  x-ray  eapability.  Perhaps  the 
respondent  misinterpreted  the  question. 

The  difference  in  average  time  as  a  provider  between  the  NPs  or  PAs  was  a  notable 
finding.  The  PAs  average  time  as  provider  was  nearly  seven  years  compared  to  the  NPs 
elinieal  experienee  of  just  over  three  years.  This  differenee  was  also  evident  in  the 
reported  number  of  ankle  evaluations  per  month.  The  NPs  reported  evaluating  over  six 
ankles  per  month  while  the  PAs  reported  an  average  of  over  13  evaluations  per  month. 
These  estimates  may  refleet  reeall,  experienee  levels,  praetiee  setting,  and/or  the  degree 
of  eonfidenee  in  evaluating  eases  of  BAT.  The  dearth  of  NP  and  PA  respondents 
reporting  work  in  emergeney  departments  (EDs)  was  noted.  This  may  be  beeause 
partieipants  do  not  work  in  this  area  or  the  time  eonstraints  of  personnel  working  in  this 
area  prevented  them  from  completing  and  returning  the  questionnaire.  Henee  NPs  and 
PAs  working  in  CONUS  EDs  may  be  underrepresented. 

Lieutenant  General  Anderson,  a  reeent  former  AF  Surgeon  General  (AF/SG),  was 
known  by  his  motto  readiness  is  job  one  .  The  study  reported  61%  of  NP  and  83%  of 
PA  respondents  were  assigned  against  mobility  positions.  Nearly  half  (48%)  of  the 
respondents  reported  experienee  with  readiness  exereises.  Six  (21%)  respondents 
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reported  aetual  involvement  with  named  deployments.  Nearly  half  (45%)  of  the 
respondents  reported  neither  readiness  exereise  involvement  nor  mission  deployment. 
Researeh  Questions 

Most  ankle  injuries  oeeur  following  exeessive  hyper-dynamie  movement  or  BAT. 
The  four  researeh  questions  sought  to  determine  what  elinieal  information,  tests  or  rules 
are  utilized  to  expedite  assessment  and  management  of  ankle  injury  and  whether  or  not  x- 
rays  were  required. 

Researeh  question  one.  The  first  researeh  question  asked  what  information,  tests  or 
rules  are  used  to  determine  if  fraeture  is  present  in  eases  of  BAT.  Results  indieate 
respondents  may  have  answered  this  item  as  if  they  were  performing  a  eomplete  ankle 
evaluation.  Respondents  reported  eonsiderable  use  of  history  items,  partieularly 
meehanism  of  injury.  Meehanism  of  injury  is  very  important,  but  if  the  injury  oeeurred 
rapidly,  or  while  foeusing  on  a  task  or  aetivity,  the  patient  may  not  know  exaetly  how  the 
injury  oeeurred  (Trevino  et  ah,  1994). 

The  respondents  did  not  mention  time  of  injury  as  being  important.  Nor  did  they 
mention  the  time  interval  between  injury  and  evaluation.  Trojian  and  MeKeag  (1998) 
diseuss  offiee  evaluation  and  the  importanee  of  the  golden  period  in  ankle  assessment. 
This  period  is  shortly  after  the  injury  and  there  is  no  swelling,  the  initial  pain  has 
subsided,  and  guarding  is  not  yet  present-  all  of  whieh  faeilitate  a  fruitful  exam  (p.  30). 
Combined  with  a  well-thought  out  history,  prompt  evaluation  ean  lead  to  proper 
diagnosis  most  of  the  time  (p.  31)  even  if  the  patient  eannot  reeall  the  meehanism  of 
injury. 
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Physical  exam  items  constituted  the  majority  of  responses  to  this  item.  No 
respondents  mentioned  examining  the  unaffected  contralateral  limb  first  as  a  useful 
reference  point  and  to  reduce  patient  anxiety.  Respondents  may  have  assumed  this  item 
as  a  basic  part  of  the  evaluation  process.  Edema/swelling  was  mentioned  more  often  than 
point  tenderness  and  less  than  the  ability  to  bear  weight/ambulate.  Edema  tends  to  have  a 
splinting  effeet  on  the  ankle  joint  eomplex.  Clarke  and  colleagues  (1995)  suggest  that  the 
presence  of  ankle  effusion  on  plain  radiographs  may  be  suggestive,  or  may  hide  an 
underlying  fracture.  Air  Force  primary  care  clinicians  have  the  eapability  of  referring 
BAT  patients  for  complex-motion  tomography  as  was  performed  by  Clarke  and 
colleagues.  In  a  field  or  combat  setting,  clinicians  must  rely  on  elinical  evaluation,  with 
less  than  100%  access  to  plain-film  x-ray  equipment. 

Foot  and  ankle  injuries  have  a  severe  impact  on  the  health  of  military  personnel  and 
mission  requirements  of  AF  airmen.  Fleming  s  (1988)  Army  study  looked  at  lower- 
extremity  injuries.  Ankle  sprain  was  the  most  prevalent  injury  to  the  combat  soldier. 
Gebbie  (1997)  has  pointed  out  the  vision  of  health  will  be  ensuring  that  people  receive 
the  care  they  need  (p.  88).  The  goal  of  the  field-assigned  FNP  or  PA  requires  an 
emphasis  on  early  determination  of  fracture,  and  a  quiek  return  of  motion,  strength,  and 
proprioception.  Miller  and  Hergenroeder  (1990)  report  that  from  36  to  72  days  may  be 
required  for  complete  rehabilitation  from  ankle  sprain  alone.  An  accurate,  timely 
diagnosis  ruling  out  significant  fractures  would  facilitate  a  quicker  return  to  full  duty  with 
reduced  morbidity. 

Of  the  numerous  provocative  tests  mentioned  as  helpful,  point  tenderness  was 
mentioned  most  often.  Responses  indicate  a  reliance  on  range  of  motion,  anterior  drawer 
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test,  and  stability  tests  (varus/valgus/talar  tilt)  almost  equally.  The  ability  to  bear  weight, 
point  tenderness  and  pain  have  been  incorporated  into  the  Ottawa  Ankle  Rules.  Shell, 
Greenberg  and  colleagues  (1992)  developed  these  criteria  based  on  the  reliability  and 
significant  fractures  associated  with  32  clinical  variables.  The  OAR  have  subsequently 
been  validated  in  several  large,  studies  (Auleley  et  ah,  1997;  Lucchesi  et  ah,  1995; 
McBride,  1997;  Pigman  et  ah,  1994;  Salt,  &  Clancy,  1997;  Verma  et  ah,  1997)  and  is 
better  than  clinical  suspicion  alone  in  detecting  fracture  (Lucchesi  et  ah,  1995). 

Research  question  two.  Research  question  two  asks  if  the  OAR  is  being  used.  Three 
respondents  mentioned  use  of  the  rules.  The  OAR  help  guide  ordering  of  radiographs  for 
acute  ankle  and  midfoot  injuries.  However,  the  rules  cannot  be  applied  if  the  NP  or  PA 
cannot  palpate  the  bone  because  of  excessive  swelling.  The  OAR,  if  properly  applied 
will  have  a  sensitivity  of  nearly  100%  (Verma  et  ah,  1997).  The  use  of  the  OAR  as  a 
clinical  guideline  when  considering  referral  to  the  x-ray  department  will  influence  the 
number  of  x-rays  requested  by  the  department.  Introduction  of  a  clinical  guideline  such 
as  the  OAR  would  be  primarily  educational  to  develop  an  optimal  strategy  for  the 
diagnosis  of  a  common  problem. 

Graham  (1998)  reports  that  the  OAR  as  clinical  decision  rules  has  gained  acceptance 
in  Canada,  and  are  in  use  by  95%  of  respondents  in  a  recent  survey  of  ED  physicians  in 
that  country.  The  respondents  in  that  randomly  selected  sample  survey  tended  to  be  of 
younger  age,  have  fewer  years  since  graduating  from  medical  school,  and  believed  that 
decision  rules  are  not  oversimplified  cookbook  medicine  or  too  rigid  to  apply.  Nearly 
100%  of  respondents  from  Graham  s  study  would  consider  using  validated  clinical 
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decision  rules  when  evaluating  whether  or  not  to  x-ray  ankle  trauma,  knee  trauma,  or  use 
computed  tomography  of  head  and  cervical  spine  in  head  injury. 

Salt  and  Clancy  (1997)  report  nurses  were  able  to  apply  the  OAR  without  missing  a 
fracture  in  one  acute  and  emergency  department  of  an  English  university  teaching 
hospital.  In  this  study,  one  of  six  senior  nurses  evaluated  ankle  trauma  following 
instruction  and  use  of  a  pocket  card.  Patients  received  subsequent  physician  evaluation. 
Of  the  86  patients  not  sent  for  x-rays  by  the  nurse,  19  had  x-rays  ordered  by  the 
physician,  who  was  similarly  instructed  in  the  use  of  the  OAR.  None  of  these  19  patients 
demonstrated  fracture.  Of  the  67  patients  receiving  an  instruction  sheet  and  no  x-ray, 
none  returned  in  the  subsequent  eight  weeks. 

Research  question  three.  A  third  research  question  asks  if  there  is  a  difference  in  the 
selective  use  of  x-rays  between  NPs  and  PAs  as  measured  by  responses  to  written  case 
scenarios.  Non-physician  providers  are  being  used  in  greater  numbers  by  the  AF  medical 
service.  Historically,  PAs  have  been  in  service  longer,  and  in  greater  numbers  than  NPs. 
Following  the  current  national  trend  to  prepare  nurses  for  primary  care,  the  AF  has 
funded  increasing  positions  for  graduate  education  as  a  NP.  Experience  as  a  provider  and 
mean  time  as  a  provider  did  not  have  an  impact  on  overall  ability  to  determine  if  x-ray 
was  required  in  the  case  scenarios.  Nurse  practitioners  were  accurate  in  83%  of  cases 
whereas  PAs  had  an  accuracy  rate  of  84%.  The  PAs  reported  examining  over  twice  as 
many  ankle  injuries  per  month  as  compared  with  NPs.  This  data  indicates  experience 
may  not  necessarily  be  correlated  with  accuracy  as  measured  by  the  written  scenarios. 

There  was  a  difference  in  the  accuracy  rate  between  NPs  and  PAs  of  6%  or  less  in 
eight  of  the  1 1  case  scenarios.  Among  these  eight  cases,  better  accuracy  was  split 
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equally,  with  each  group  answering  four  of  the  eight  cases  with  greater  accuracy  than  the 
other  group.  In  one  case,  NPs  and  PAs  both  answered  with  100%  accuracy  each.  In  the 
three  remaining  cases  accuracy  between  groups  varied  1 1  to  17%.  The  NPs  were  100% 
accurate  in  one  case.  The  PAs  were  100%  accurate  in  five  cases.  Clinical  experience 
among  respondents  within  each  group  may  have  been  a  factor  in  differences  among  and 
between  cases,  and  between  providers,  although  results  may  be  affected  by  whether 
respondents  completed  the  questionnaire  alone  or  sought  out  assistance,  or  perhaps 
worked  together  on  multiple  questionnaires.  This  factor  may  explain  the  relatively  low 
accuracy  of  NPs  and  the  100%  accuracy  by  PAs  in  case  3. 

Case  4  and  1 1  had  the  lowest  accuracy  rates  for  both  NPs  and  PAs.  Dr.  Stiell 
(personal  communication,  July  17,  1998)  in  his  expert  review  of  the  questionnaire, 
considered  these  cases  slightly  irrelevant  and  unlikely  since  Normally  a  clinician 
would  only  test  the  ability  to  bear  weight  if  no  tenderness.  You  ask  more  difficult 
questions  to  determine  comprehension  of  ability  to  bear  weight .  Dr.  Stiell  s  comments 
presume  there  would  be  pain  in  the  malleolar  zone  if  you  had  either  medial  or  lateral 
tenderness.  Based  on  Dr.  Stiell  s  input,  the  statement  able  to  bear  weight  was  added  to 
each  of  these  cases  to  make  these  particular  scenarios  more  realistic.  In  these  two  cases, 
it  would  appear  that  bone  tenderness  without  pain  suggest  an  x-ray  should  be  ordered 
inaccurately  by  approximately  half  of  all  respondents;  presumably  to  aid  in  diagnosis.  In 
these  two  cases,  more  clinical  information  may  have  been  sought,  or  the  terms  bone 
tenderness  and  pain  may  have  been  considered  synonymous. 

Research  question  four.  The  final  question  asks  if  there  is  a  theoretical  financial 
benefit  to  using  the  Ottawa  Ankle  Rules.  This  study  reported  a  significant  estimated 
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dollar  savings  if  OAR  are  utilized  to  evaluate  BAT  when  only  the  cost  of  x-ray  was 
considered.  The  average  cost  of  BAT  ranges  from  $300-$900  for  diagnosis  and 
rehabilitation  (Weinstein,  1993).  Stiell  (1996)  estimates  $500,000,000  is  spent  annually 
on  ankle  radiography  in  the  United  States  and  Canada.  Rigler  (1976)  feels  the  true 
monetary  cost  lies  with  the  usage  of  other  consultants  or  other  radiologists  after  x-rays 
are  obtained. 

The  theoretical  cost  of  an  x-ray  for  this  study  was  determined  using  information 
from  a  single  East  Coast  AF  medical  center.  The  theoretical  cost  benefit  is  similar  to 
other  studies  and  economic  analysis  concerning  x-ray  use  in  ankle  injury  episodes 
(Michelson  et  al.,  1995;  Squillace  &  Slawson,  1994;  Stiell  et  ah,  1995;  Stiell,  McKnight, 
et  ah,  1994).  Study  findings  support  a  conclusion  that  using  OAR  as  part  of  a  complete 
evaluation  of  BAT  by  non-physician  providers  would  result  in  substantial  cost  saving. 

Recommendations 

Improving  quality  while  containing  costs  is  arguably  one  of  the  highest  priorities  in 
the  AF  medical  service  today.  The  development  of  practice  guidelines  such  as  the  OAR, 
began  recently  in  medicine.  Wasson  and  Sox  (1996)  suggest  that  the  objective  of 
clinical  prediction  rules  is  to  reduce  the  uncertainty  inherent  in  medical  practice  by 
defining  how  to  use  clinical  findings  to  make  predictions.  Use  of  the  OAR  by  NPs  and 
PAs  will  support  outcome  measures  that  show  that  these  clinicians  provide  competent 
and  efficient  health  care  resulting  in  overall  cost  savings  and  better  care.  These  validated 
rules  guide  practice  and  have  the  potential  to  increase  the  safe  use  of  judicious  ankle 
radiography,  decrease  waiting  times,  and  reduce  overall  costs  as  AF  health  care  moves 
into  the  21st  century. 
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Use  of  the  OAR  in  the  field  and  offiee  setting  would  deerease  evaluation  time,  offer 
a  greater  degree  of  eonfidenee  in  diagnosis,  and  ensure  the  safe  return  of  airmen  to  duty 
more  quiekly.  Readiness  and  mobility  training  and/or  assignments  are  an  inherent  part  of 
military  praetiee  as  reported  in  the  study.  The  OAR  demonstrate  proven  benefits  and 
would  be  a  helpful  tool  in  the  field,  by  eonserving  teehnology  and  bolstering  diagnostie 
eonfidenee  in  austere  eonditions. 

Praetiee  guidelines  historieally  have  been  under-disseminated  (Woolf,  1992).  No 
type  of  guideline  is  inherently  effeetive,  partieularly  if  used  in  isolation.  Collaborative 
edueation  programs  (in-serviee  seale)  for  all  types  of  providers  eould  be  instituted  that 
allow  for  a  value-added  skill  used  in  eneounters  with  BAT  patients  in  military  treatment 
faeilities  (MTFs)  and  in  the  field.  Greeo  and  Eisenberg  (1997)  suggest  that  many 
providers  are  reluetant  to  ehange  praetiee  even  when  randomized  trials  demonstrate 
effeetiveness. 

An  edueation  proeess  on  the  OAR,  or  feedbaek  as  to  how  an  individual  praetiee 
eompares  to  that  of  peers,  ean  positively  affeet  patient  outeomes.  By  observing  the  OAR 
being  used  in  praetiee,  elinieians  may  well  adopt  this  simple,  safe,  and  helpful  tool. 
Written  ease  seenarios  as  used  in  this  study  may  prove  benefieial  in  training  elinieians  in 
the  use  of  the  OAR.  Standardized  poeket  eards  are  available  as  well  as  a  poster 
deseribing  the  OAR  for  a  nominal  fee.  Instruetion  would  take  less  than  30  minutes,  and 
as  part  of  a  reeurring  staff  meeting,  reeeive  widest  loeal  dissemination.  Administrative 
assuranee  of  this  quality  improvement  intervention  would  detail  positive  outeomes  and 
best  tests  are  used  in  the  evaluation  of  BAT.  Use  of  the  OAR  eould  be  taught  utilizing 
a  ease  seenario  method  as  in  this  thesis.  Edueation  of  the  OAR  utilizing  written  or 
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moulage  scenarios  would  enhance  war  skills  training  and  the  readiness  of  military  health 
eare  providers  in  preparing  for  operations  other  than  war  or  care  in  other  field  eonditions. 
In  this  unique  setting,  prompt,  aeeurate  determination  of  duty  abilities  is  vital. 

Clinieal  guidelines  began  as  a  form  of  edueation  and  are  beeoming  a  part  of  the 
standard  of  praetiee  in  many  praetiee  arenas  (Greeo  &  Eisenberg,  1997).  The  study 
reported  in  this  thesis  demonstrated  that  a  majority  of  NPs  and  PAs  were  unaware  of  the 
OAR.  In  patient  encounters,  the  prudent  provider  determines  patient  expeetations  and 
provides  information  on  the  disease  proeess.  An  edueational  pamphlet  used  during  BAT 
encounters  would  serve  to  educate  the  patient  as  to  why  x-rays  were  done  (or  not  done). 
This  edueational  sheet  eould  inelude  follow-up  instruetions  including  when  to  return  for 
re-evaluation. 

Replieation  of  this  study  at  Air  Foree  MTFs  would  provide  a  deseription  of  provider 
demographies  and  determine  knowledge  of  BAT  evaluation.  A  further  reeommendations 
would  be  to  randomly  place  the  yes  or  no  ease  seenarios  within  the  instrument  to 
eliminate  guesswork  bias.  Replieation  with  respondents  from  eaeh  TRICARE  region 
may  reveal  geographie  differenees  in  the  way  BAT  eases  are  evaluated.  A  retrospeetive 
study  of  MTF  reeords  might  reveal  slippage  in  the  doeumentation  of  BAT  assessment 
(point  tenderness  or  ability  to  bear  weight)  or  overuse  of  x-rays  in  real  cases,  justifying 
a  trial  of  the  OAR.  The  OAR  are  safe  and  effeetive  to  use  in  eonjunetion  with  a  eomplete 
evaluation  proeess. 

Summary 

This  deseriptive  study  demonstrated  the  abilities  of  NPs  and  PAs  to  determine  if  an 
x-ray  was  required  in  written  cases  of  BAT  with  near-equal  aeeuraey.  Unique 
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demographic  aspects  of  a  military  sample  of  NPs  and  PAs  were  shown.  Mobility  and 
mission  readiness  are  aspects  unique  to  military  health  care  providers.  Respondents 
reported  participation  in  these  activities.  Respondents  generally  did  not  recognize  the 
OAR  as  a  helpful  guide  in  the  determination  of  whether  or  not  to  obtain  an  x-ray  when 
evaluating  blunt  ankle  trauma.  Accuracy  in  the  decision  to  x-ray  in  cases  of  BAT  would 
be  improved  through  correct  and  consistent  use  of  the  Ottawa  Ankle  Rules.  Local 
clinical  trials  would  facilitate  adoption  of  the  OAR  as  a  standard  of  practice  in  cases  of 
BAT. 

Providers  in  the  MTF,  working  in  primary  care  or  acute  settings,  may  be  unaware  of 
the  OAR.  In  this  case,  a  brief  educational  intervention  is  recommended  using 
standardized  products.  Military  leaders  recognize  the  importance  of  satisfied  customers. 
Leaders  direct  military  clinical  care  amidst  a  paradigm  shift  that  has  taken  centuries  to 
develop.  The  neglect  of  military  personnel  in  the  past  has  given  way  to  federally- 
mandated  concern  for  military  members  and  their  families  (Roark  &  Tucker,  1997). 
Provider  values  concerning  health  care  and  the  beneficiary  expectations  are  changing  in 
line  with  economic  realities.  Widest  use  of  the  OAR  within  the  AF  medical  service  by 
NPs  and  PAs  will  improve  customer  service  by  decreasing  waiting  times,  and  lowering 
treatment  costs  within  the  clinical  service.  Time  saved  can  be  utilized  in  educating  the 
sophisticated  beneficiary  during  the  encounter.  Education  is  a  value-added  item 
ultimately  bringing  about  positive  change  in  the  AF  medical  service. 

The  positive  reasons  for  supporting  clinical  guidelines  like  the  OAR  outweigh  any 
negative  ones.  Use  of  the  OAR  would  bring  order  and  some  measure  of  predictability  to 
the  evaluations  of  BAT.  Even  more  compelling,  it  could  lead  to  a  more  satisfying 
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relationship  with  our  patients.  It  is  possible  for  personal  and  soeietal  values  to  be 
weighed  while  health  eare  deeisions  are  made.  Nurse  praetitioners  and  physieian 
assistants  have  an  opportunity  to  use  a  simple  guideline,  making  it  part  of  the  standard  of 
praetiee  in  evaluating  blunt  ankle  trauma. 
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APPENDIX  A;  Blunt  Ankle  Injury  Questionnaire 


Appendix  A 


BLUNT  ANKLE  INJURY  QUESnONNAIRE 

Approved:  USAF  SCN  98-52 

PERSONAL  INFORMATION  (Please  check  those  that  apply) 

Nurse  Praetitioner  (NP)  _  AFSC _ 

Physieian  Assistant  (PA)  _  AFSC _ 

How  long  as  a  PA  or  NP?  (months) _ 

Education  level:  Baehelor  s  _  Certifieate  _  Master  s  _ 

PhD  _  Other  _  (Deseribe): _ 

Practice  setting  (Check  One):  Non-clinical  _  Primary  Care  _ 

Emergency  Department  _  Other  _(describe)  _ 


Are  you  assigned  to  a  mobility  position?  YES  _  NO 

Past  deployments  (check  all  that  apply) 

Vietnam  War  _  Gulf  War  _  Restore  Hope  _ 


Just  Cause  _  Bosnia  _  Exercises  _ 

Other  Describe: _ 

How  many  ankle  injuries  do  you  treat  in  a  month?  (specify  number): _ 

Do  you  have  X-  RAY  capabilities  in  your  current  practice  location?YES  _  NO 


What  clinical  information  and/or  tests  do  you  utilize  to  determine  if  an  x-ray  test  is 
required  in  cases  of  blunt  ankle  trauma? 


{Continued  on  page  3) 


Page  2 


Diagram  to  accompany  the  Blunt  Ankle  Injury  Questionnaire 

UMd  with  permission  (IMS). 

Mnillam  A.  Novak 


BLUNT  ANKLE  INJURY  QUESTIONNAIRE 


*For  each  case  below,  utilize  the  diagram  on  paQe2. 

-Each  of  the  following  patients: 

—present  in  the  clinie  with  aeute,  non-bleeding  ankle  injury. 

—is  not  pregnant  and  over  18  years  of  age. 

—present  for  the  first  time  in  the  ambulatory  setting  and, 

—has  no  eognitive  or  sensory  impairment. 


WOULD  YOU  ORDER  AN  X-RAY  FOR  EACH  OF  THESE  PATIENTS  BASED  ON  THE 

FOLLOWING  PHYSICAL  EXAM 


1 .  Pain  in  the  malleolar  zone  AND  bone 
tenderness  at  the  posterior  edge  or  tip  of 
the  lateral  malleolus 

YES  _  NO  _ 

2.  Pain  in  the  midfoot  zone  AND  no 
bone  tenderness  at  the  navieular  bone, 
able  to  bear  weight  both  immediately 
and  in  the  clinic 

YES_  NO_ 

3.  Pain  in  the  malleolar  zone  AND  bone 
tenderness  at  the  posterior  edge  or  tip  of 
the  medial  malleolus 

YES_  NO_ 

4.  No  pain  in  the  malleolar  zone,  AND 
bone  tenderness  at  the  posterior  edge  or 
tip  of  lateral  malleolus;  able  to  bear 
weight 

YES_  NO_ 

5.  Pain  and  tenderness  in  the  midfoot 
zone  AND  inability  to  bear  weight  both 
immediately  and  in  the  elinic 

YES_  NO_ 

6.  Pain  in  the  malleolar  zone  AND  able 
to  bear  weight  both  immediately  and  in 
the  clinic,  without  bone  tenderness 

YES  NO 


7.  Pain  in  the  midfoot  zone  AND  bone 
tenderness  at  the  base  of  the  5^*' 
metatarsal 

YES_  NO_ 

8.  Pain  in  the  midfoot  zone  AND  no 
bone  tenderness  at  the  base  of  the  5* 
metatarsal,  able  to  bear  weight  both 
immediately  and  in  the  clinie 

YES_  NO_ 

9.  Pain  and  tenderness  in  the  malleolar 
zone  AND  inability  to  bear  weight  both 
immediately  and  in  the  elinie 

YES_  NO_ 

10.  Pain  in  the  midfoot  zone  AND  bone 
tenderness  at  the  navicular  bone 

YES_  NO_ 

1 1 .  No  pain  in  the  malleolar  zone  AND 
bone  tenderness  at  the  posterior  edge  or 
tip  of  the  medial  malleolus;  able  to  bear 
weight. 

YES_  NO_ 

Thank  you  for  your  responses.  Please 
place  both  pages  in  the  self-addressed, 
stamped  envelope  and  mail. 


APPENDIX  B;  Blunt  Ankle  Injury  Codex 


Codex  for  Blunt  Ankle  Trauma. 


Appendix  B 


Nurse  Praetitioner 


Adult  la 

Primary  eare  lb 

Family  le 

AFSC  (verbatim) 
Physieian  s  Assistant 

General  duty  2a 

Orthopedie  2b 

General  surgery  2e 

AFSC  (verbatim) 


How  long:  x  months 


Gulf  War  6b 

Restore  Hope  6e 

Just  Cause  6d 

Bosnia  6e 

Readiness  Exereises  6f 

Other  (deseribed)  6g 

None  eheeked  0 

Number  of  ankle 


iniuries/month: 


=X 


X-ray  eapability  at  faeiliE 

YES 

NO 


7a 

7b 


Praetiee  Setting 

Non-Clinieal 

3a 

Primary  Care 

3b 

ED 

3e 

Other 

3d 

What  elinieal  information,  tests,  and/or 
rles  do  you  utilize  to  determine  if  an  x- 
ray  test  is  required  in  eases  of  blunt 
ankle  trauma? 

Verbatim  reeording 


Edueation  Level 

Baehelor 

4a 

Certifieate 

4b 

Master  s 

4e 

PhD  (doetorate) 

4d 

Other  (deseribe) 

4e 

Mobility 

YES- 

5a 

NO- 

5b 

Past  deployments: 

Case  Studies: 


Case 

YES 

NO 

1 

8al 

8b  1 

2 

8a2 

8b2 

3 

8a3 

8b3 

4 

8a4 

8b4 

5 

8a5 

8b5 

6 

8a6 

8b6 

7 

8a7 

8b7 

8 

8a8 

8b8 

9 

8a9 

8b9 

10 

8al0 

8bl0 

11 

8all 

8bll 

Vietnam  War 


6a 


APPENDIX  C:  Uniformed  Services  University  of  the  Health  Sciences  IRB  Review  and 
Approval  of  Protocol  T06812  for  Human  Subject  Use 


Appendix  C 


July  29,  1998 

MEMORANDUM  FOR  CAPT  WILLIAM  A.  NOVAK,  GRADUATE  SCHOOL  OF  NURSING 
SUBJECT:  IRB  Review  and  Approval  of  Protoeol  T06182  for  Human  Subjeet  Use 


Your  researeh  protoeol,  entitled  Use  of  Ottawa  [sie]  Ankle  Rules  to  Evaluate  Blunt 
Ankle  Trauma  Case  Studies  by  USAF  Health  Care  Providers,  was  reviewed  and 
approved  for  exeeution  on  July  28, 1998  as  an  exempt  human  subjeet  use  study  under 
the  provisions  of  32  CFR  219.101(b)(2).  This  approval  will  be  reported  to  the  full  IRB, 
seheduled  to  meet  on  August  13,  1998. 

The  IRB  understands  that  this  study  uses  a  questionnaire  sent  to  eighty  randomly  ehosen 
Air  Foree  physieian  s  assistants  to  obtain  data  on  prineiples  behind  treatment  deeisions 
about  hypothetieal  ankle  injuries.  The  data  will  then  be  eompared  to  treatment  guidelines 
set  out  in  the  Ottowa  [sie]  Ankle  Rules.  None  of  the  information  eolleeted  will  be 
traeeable  to  any  individual  subjeet,  and  only  aggregates  will  be  reported. 

Please  notify  this  offiee  of  any  amendments  or  ehanges  in  the  approved  protoeol  that  you 
might  wish  to  make  and  of  any  untoward  ineidents  that  may  oeeur  in  the  eonduet  of  this 
projeet.  If  you  have  any  questions  regarding  human  volunteers,  please  eall  me  at  301- 
295-3303. 


-Signed- 

Riehard  R.  Levine,  Ph.D. 

ETC,  MS,  USA 

Direetor,  Researeh  Programs  and 
Exeeutive  Seeretary,  IRB 


APPENDIX  D:  United  States  Air  Foree  Survey  Approval  Letter 


Appendix  D 


7  July  1998 


MEMORANDUM  FOR  CAPTAIN  NOVAK 

FROM:  HQAFPC/DPSAS 

550  C  Street  West  Suite  35 
Randolph  AFB  TX  78150-4737 

SUBJECT:  USAF  Control  Number  (Your  e-mail,  7  July  1998) 

Your  proposed  Blunt  Ankle  Injury  Questionnaire  has  been  reviewed  and  is 
assigned  a  Survey  Control  Number  (SCN)  of  USAF  SCN  98-52.  This  number  and 
authorization  will  expire  on  31  Deeember  1998. 

With  regard  to  the  survey  and  its  assoeiated  results,  it  is  important  to  draw  your 
attention  to  the  provisions  of  the  Freedom  of  Information  Act  (FOIA).  Under  the  FOIA, 
the  results  of  your  survey  can  be  requested  by  the  public.  Additionally,  please  forward  a 
copy  of  the  final  version  of  the  survey  for  our  files.  Finally,  the  SCN  needs  to  appear 
either  in  the  cover  letter  or  on  the  face  of  the  survey  itself 

Questions  or  concerns  can  be  directed  to  me  or  Mr.  Hamilton  at  (210)  652-5680. 
Thank  you  and  good  luck  with  your  data  collection  efforts. 


-Signed- 


MICHAEF  J.  BENSON,  Fieutenant, 
USAF 

Personnel  Survey  Analyst 
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20  Aug  1998 


HQ  AFPC/MSIMD 

550  C  Street  West  Suite  48 

Randolph  AFB  TX  78150-4750 

Captain  William  A.  Novak,  USAF 
Uniformed  Serviees  University 
4028-1  Ashwood  Cirele 
Andrews  AFB  MD  20762 

Dear  Captain  Novak, 

This  is  in  response  to  your  Freedom  of  Information  Act  (FOIA)  request 
(#98-0681)  of  13  Jul  98.  The  attached  listing  consists  of  releasable  information 
on  active  duty  Air  Force  nurse  practitioners  and  physicians  assistants,  but 
excludes  personnel  assigned  overseas,  or  in  classified,  sensitive,  or  routinely 
deployable  units.  The  list  also  includes  the  eight  nurse  practitioners  who  returned 
to  active  duty  from  USUHS  last  spring. 

Under  Department  of  Defense  4525.8  —  Manal/Air  force  supplement. 
Official  Mail  Manual,  dated  18  April  1994,  the  Base  Information  Transfer 
System  will  not  deliver  unofficial  mass  mailings  addressed  to  individuals  at  the 
duty  address.  We  define  a  mass  mailing  as  50  or  more  pieces  of  mail  received  on 
the  same  day  from  the  same  mailer.  In  this  context,  unofficial  mail  is  mail 
addressed  to  an  individual  that  does  not  have  an  official  return  address  from  a 
government  agency.  The  1996  Mail  Reclassification  requires  a  full  street  address 
which  our  present  system  does  not  contain. 

Sincerely 


DARREFF  VEGA,  AlC,  USAF 

Information  Fifecycle  Mgt,  FOIA,  PA  Technician 
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Follow-up  Mailer  Example 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 

If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 

If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 

If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 

If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 


If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 


Graduate  School  of  Nursing,  Student  mailbox  #849 
4301  Jones  Bridge  Road 
Bethesda,  MD  20034 

BLUNT  ANKLE  INJURY  QUESTIONNAIRE 

Thanks  in  advance  for  completing  and  returning  the  survey  I 
recently  mailed  to  your  business  address  under  your  name.  If 
you  did  not  receive  this  survey,  contact  me  by  phone  and  I  d 
be  happy  to  provide  a  second  copy.  Rest  assured  your 
responses  are  completely  confidential. 


If  you  have  any  questions,  please  don  t  hesitate  to  call : 
(301)599-0675. 

Captain  Bill  Novak,  USAF,  NC 
FAMILY  NURSE  PRACTITIONER  PROGRAM 
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Permission  To  Use  Ottawa  Ankle  Rules 


From  eleetronie  mail  reeeived  20  April,  1998 
Subj:  Re:  Permission;  Request  Grad  student  use  of  Ottawa  Ankle  Rules 
Date:  98-04-20  09:54:28  EDT 
From:  <istiell  @lri.oa>  (Ian  Stiell  MD) 

To:  <Novbike  @aol.oom>  (Novbike) 


Dear  Mr.  Novak 

You  eertainly  may  have  my  permission  to  use  the  OAR  in  your  thesis  study.  The 
figure  is  fixed  and  I  am  uneomfortable  when  people  attempt  to  alter  how  the  oar  is 
depieted.  I  would  appreeiate  seeing  exaetly  how  you  plan  to  use  the  OAR. 

Good  luek  with  your  study. 


Return-Path  <istiell  @lri.ea> 
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Consent  Form 

Purpose.  This  research  study  is  to  describe  the  clinical  information,  tests  or  rules  United  States 
Air  Force  (USAF)  health  care  providers  use  to  evaluate  written  cases  of  blunt  ankle  trauma. 
Investigator:  William  A.  Novak,  Captain,  USAF,  NC 
Uniformed  Services  University  of  the  Health  Sciences  (USUHS) 

Graduate  School  of  Nursing,  Department  of  Family  Nurse  Practitioner 
4301  Jones  Bridge  Road 
Bethesda,  Maryland  20034 
Investigator  USUHS  Mail  Box:  GSN  #849 

Home:  (301)  599-0675  Office:  (301)  295-1992 

Condition  for  Participation.  You  must  be  an  active  duty  Adult/Primary  Care/Family  Nurse 
Practitioner  or  Physician  Assistant  in  the  USAF  during  the  survey  period. 

Procedure/Tasks.  Each  participant  is  asked  to  complete  the  accompanying  three  page  Blunt 
Ankle  Injury  Questionnaire  and  return  it  to  the  investigator  via  mail  return  of  the  questionnaire  in 
the  self-addressed,  postage-paid  envelope  provided. 

Risk/Benefit.  This  study  involves  no  physical  risk  or  discomfort  to  you.  While  this  study  may 
not  help  you  personally,  it  may  help  USAF  providers  determine  what  information  is  required  to 
make  a  decision  to  x-ray  in  cases  of  blunt  ankle  trauma.  If  you  have  any  questions  about  your 
participation  in  this  study,  please  contact  the  investigator  or  the  Office  of  Research  at  USUHS 
phone:  (301)  295-3303. 

Confidentiality.  Any  information  obtained  will  be  kept  strictly  confidential  and  protected  to  the 
fullest  extent  of  the  law.  Information  you  provide  and  records  related  to  this  study  will  be 
accessible  only  to  the  investigator,  USUHS  Institutional  Review  Board  and  other  Federal 
agencies  providing  oversight  for  human  use  protection.  You  have  the  right  to  withdraw  from  the 
study  at  any  time.  You  have  the  right  not  to  answer  any  or  all  of  the  questions.  Please  do  not 
write  any  identifying  information  such  as  name,  phone  number,  address,  or  social  security 
number  on  the  questionnaire. 

Cost.  Your  participation  is  appreciated.  There  is  no  cost  to  you  for  your  participation  in  this 
study.  You  will  not  receive  any  monetary  reimbursements  or  rewards  for  your  participation. 

Information  from  the  investigator.  The  investigator  will  be  happy  to  answer  any  questions 
regarding  this  study.  This  study  is  sponsored  by  USUHS,  Bethesda,  Maryland.  The  results  of  the 
study  will  be  available  through  the  Graduate  School  of  Nursing,  Nursing  Research  Department. 

Consent.  To  maintain  anonymity,  completion  and  return  of  this  questionnaire  implies  consent  for 
inclusion  in  the  study. 


THANK  YOU  FOR  YOUR  PARTICIPATION. 


